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Abstract 


The  Advanced  Deployable  Day/Night  Simulation  (ADDNS)  Technology  Demonstration  Project 
was  initiated  to  design,  develop,  and  deliver  transportable  visual  simulations  that  jointly  provide 
night- vision  and  high-resolution  daylight  capability.  The  project  includes  research  and 
development  on  deployable  display  technologies  for  realistic  day  and  night  training  operations, 
extends  the  knowledge  of  human  factors  with  night  vision  devices,  and  the  ability  to  represent 
dangerous  or  extreme  scenarios  for  day  and  night  operations  in  general.  On  November  13th  and 
14th  2007  the  Advanced  Deployable  Day/Night  Simulation  Technical  Demonstration  Project  held 
a  symposium  at  Defence  Research  Development  Canada  in  Toronto.  Many  contributions  were 
made  by  professionals  in  the  fields  of  human  factors,  image  generation,  projection  technologies, 
and  photogrammetry.  The  abstracts  of  papers  presented  at  the  symposium  are  in  this  technical 
report,  in  both  official  languages. 

The  intent  of  this  effort  is  to  aid  operational  readiness  by  advancing  the  visual  simulation 
capabilities  of  training  simulators  so  that  they  can  be  deployed  for  mission  rehearsal.  This 
objective  can  be  achieved  by  developing  high-resolution,  multi-spectral  visual  simulation 
capabilities  that  integrate  advancements  of  laser  projection  technology,  and  physics-based 
modelling  of  night  vision  devices  with  terrain  representations  that  can  incorporate 
reconnaissance  data. 


Resume 


Le  Projet  du  simulateur  deployable  avance  pour  la  vision  de  jour  et  de  nuit  (ADDNS  :  projet  de 
demonstration  de  technologic)  prevoit  la  conception,  le  developpement  et  la  livraison  d'un 
simulateur  transportable  qui  foumira  a  la  fois  une  capacite  de  vision  nocturne  et  une  capacite 
d'affichage  diume  de  haute  resolution.  Ce  projet  comprend  des  travaux  de  recherche  et  de 
developpement  sur  la  technologic  des  systemes  d'affichage  deployables  pour  des  operations 
d’entrainement  realiste  de  jour  et  de  nuit  et  augmente  les  connaissances  de  Tergonomie 
relativement  aux  appareils  de  vision  nocturne  ainsi  que  la  capacite  de  representer  des  scenarios 
dangereux  ou  extremes  pour  les  operations  de  jour  et  de  nuit  en  general.  Les  13  et  14  novembre 
2007,  les  responsables  du  Projet  du  simulateur  deployable  avance  pour  la  vision  de  jour  et  de  nuit 
ont  tenu  un  symposium  a  Recherche  et  developpement  pour  la  defense  Canada  -  Toronto.  De 
nombreuses  presentations  ont  ete  faites  par  des  professionnels  dans  les  domaines  suivants  : 
ergonomie,  production  d'images,  technologies  de  projection  et  photogrammetrie.  Les  resumes  des 
presentations  qui  ont  ete  faites  pendant  le  symposium  se  trouvent  dans  le  present  rapport 
technique,  dans  les  deux  langues  officiels. 

L’oeuvre  present  vise  a  ameliorer  l’etat  de  preparation  operationnelle  en  perfectionnant  les 
capacites  de  simulation  visuelle  des  simulateurs  destines  a  l’entrainement  de  sorte  qu’ils  puissent 
etre  utilises  pour  les  repetitions  en  vue  d’une  mission.  La  realisation  d’un  tel  objectif  passe  par  le 
developpement  de  capacites  de  simulation  visuelle  multi  spectrale  a  haute  resolution  integrant  les 
progres  realises  dans  les  domaines  de  la  technologie  de  projection  laser,  et  de  la  modelisation  des 
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dispositifs  de  vision  nocturne  basee  sur  la  physique  avec  des  representations  de  terrain  qui 
pourraient  comprendre  des  donnees  de  reconnaissance. 
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Executive  summary 


A  Summary  of  proceedings  for  the  Advanced  Deployable 
Day/Night  Simulation  Symposium: 

Keith  K.  Niall,  ed.  ;  DRDC  Toronto  TR  2009-121;  Defence  R&D  Canada  - 
Toronto;  July  2009. 

Introduction:  The  Advanced  Deployable  Day/Night  Simulation  (ADDNS)  Technology 
Demonstration  Project  was  initiated  to  design,  develop,  and  deliver  transportable  visual 
simulations  that  jointly  provide  night- vision  and  high-resolution  daylight  capability.  The  project 
includes  research  and  development  on  deployable  display  technologies  for  realistic  day  and  night 
training  operations,  extends  the  knowledge  of  human  factors  with  night  vision  devices,  and  the 
ability  to  represent  dangerous  or  extreme  scenarios  for  day  and  night  operations  in  general.  On 
November  13th  and  14th  2007  the  Advanced  Deployable  Day/Night  Simulation  Technical 
Demonstration  Project  held  a  symposium  at  Defence  Research  Development  Canada  in  Toronto. 
The  key  note  speaker  for  the  symposium  was  Mary  Kaiser  from  NASA/ Ames.  There  were  four 
sessions,  projection  technologies,  image  generation,  human  factors  and  photogrammetry. 

Two  sessions  were  held  on  November  13th  2007,  projection  technologies  and  image  generation. 
The  projection  technologies  session  was  chaired  by  Dr.  Keith  Niall  (DRDC  Toronto),  the 
presenters  were  Mr.  Francis  Picard  (INO),  Mr.  Michel  Doucet  (INO),  and  Mr.  Jeff  Clark 
(Renaissance  Sciences  Corporation).  Dr.  Ming  Hou  (DRDC  Toronto)  acted  as  session  chair  for 
the  image  generation  session.  Robert  Wolfe  (Serenica  Corp.),  Ray  Obidowski  (Array  Systems 
Computing  Inc.),  and  Christine  Covas  (Air  Force  Research  Laboratory)  presented  papers  during 
the  image  generation  session. 

The  last  two  sessions,  human  factors  and  photogrammetry  were  held  on 
November  14th  2007.  Dr.  Jocelyn  Keillor  (DRDC  Toronto)  was  the  session  chair  for  human 
factors;  presentations  were  made  by  Dr.  James  Gaska  (Link  Simulation  Training),  Professor 
Michelle  Gauthier  (CAE  Professional  Services),  Professor  Robert  Allison  (Centre  for  Vision 
Research,  York  University)  and  Professor  Don  Donderi  (Human  Factors  North).  The  session 
chair  for  photogrammetry  was  Dr.  Richard  Wildes  (York  University);  Mr.  Vitaly  Zholudev 
(Department  of  Computer  Science,  York  University),  Mr.  X.  Zhu  (Neptec  Design  Group),  and  Dr. 
Paul  Thomas  (Topaz  Technologies)  presented  during  this  session. 

Results:  The  ADDNS  symposium  allowed  sharing  of  current  research  in  the  fields  of  human 
factors,  projection  technologies,  image  generation,  and  photogrammetry.  Professionals  were  able 
to  communicate  their  current  findings  and  research  with  others  in  related  fields  of  expertise.  The 
symposium  also  educated  attendees  about  the  different  technologies  occurring  around  the  world 
today.  Visual  systems  for  current  simulators  have  been  limited  by  sufficient  resolution  for 
operators  to  perform  a  full  range  of  tactical  manoeuvres;  similarly,  they  have  not  enabled  training 
and  rehearsal  for  night  operations.  Moreover,  the  information  available  in  geographic  databases 
may  be  limited  in  currency  and  availability.  Advances  in  image  projection,  image  generation,  and 
photogrammetric  technologies  have  made  it  possible  to  address  some  of  these  deficiencies. 
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Sommaire 


A  summary  of  proceedings  for  the  Advanced  Deployable 
Day/Night  Simulation  Symposium: 

Keith  K.  Niall,  ed.;  DRDC  Toronto  TR  2009-121;  R  &  D  pour  la  defense  Canada  - 
Toronto;  juillet  2009. 

Introduction  :  Le  Projet  du  simulateur  deployable  avance  pour  la  vision  de  jour  et  de  nuit 
(ADDNS  :  projet  de  demonstration  de  technologie)  prevoit  la  conception,  le  developpement  et  la 
livraison  d'un  simulateur  transportable  qui  fournira  a  la  fois  une  capacite  de  vision  nocturne  et 
une  capacite  d'affichage  diume  de  haute  resolution.  Ce  projet  comprend  des  travaux  de  recherche 
et  de  developpement  sur  la  technologie  des  systemes  d'affichage  deployables  pour  des  operations 
d’entrainement  realiste  de  jour  et  de  nuit  et  augmente  les  connaissances  de  l’ergonomie 
relativement  aux  appareils  de  vision  nocturne  ainsi  que  la  capacite  de  representer  des  scenarios 
dangereux  ou  extremes  pour  les  operations  de  jour  et  de  nuit  en  general.  Les  13  et  14  novembre 
2007,  les  responsables  du  Projet  du  simulateur  deployable  avance  pour  la  vision  de  jour  et  de  nuit 
ont  tenu  un  symposium  a  Recherche  et  developpement  pour  la  defense  Canada  -  Toronto. 
Mary  Kaiser,  de  la  NASA/ Ames,  a  ete  Toratrice  principale  du  symposium.  II  y  a  eu  quatre 
seances  :  technologies  de  projection,  generation  d’images,  ergonomie  et  photogrammetrie. 

Deux  seances  ont  eu  lieu  le  13  novembre  :  technologies  de  projection  et  generation  d’images.  La 
seance  sur  les  technologies  de  projection  a  ete  presidee  par  Keith  Niall  (RDDC  Toronto),  et  les 
presentations  ont  ete  donnees  par  Francis  Picard  (INO),  Michel  Doucet  (INO)  et  Jeff  Clark 
(Renaissance  Sciences  Corporation).  Ming  Hou  (RDDC  Toronto)  a  preside  la  seance  sur  la 
generation  d’images.  Robert  Wolfe  (Serenica  Corp.),  Ray  Obidowski  (Array  Systems  Computing 
Inc)  et  Christine  Covas  (Air  Force  Research  Laboratory)  ont  donne  des  exposes  pendant  la  seance 
sur  la  generation  d’images. 

Les  deux  dernieres  seances,  sur  l’ergonomie  et  la  photogrammetrie,  ont  eu  lieu  le 
14  novembre  2007.  Jocelyn  Keillor  (RDDC-Toronto)  a  preside  la  seance  sur  l’ergonomie.  James 
Gaska  (Link  Simulation  Training),  Michelle  Gauthier  (Services  professionnels,  CAE),  Robert 
Allison  (Centre  for  Vision  Research,  Universite  York)  et  Don  Donderi  (Human  Factors  North) 
ont  donne  des  presentations.  La  seance  sur  la  photogrammetrie  a  ete  presidee  par  Richard  Wildes 
(Universite  York);  Vitaly  Zholudev  (Departement  d’informatique,  Universite  York),  X. 
Zhu  (Neptec  Design  Group)  et  Paul  Thomas  (Topaz  Technolgies)  y  ont  donne  des 
presentations. 

Resultats  :  Le  symposium  sur  le  ADDNS  a  permis  d'echanger  sur  les  travaux  de  recherche 
actuels  dans  les  domaines  de  l’ergonomie,  des  technologies  de  projection,  de  la  generation 
d’images  et  de  la  photogrammetrie.  Les  professionnels  ont  ete  en  mesure  de  communiquer  leurs 
conclusions  actuelles  et  les  resultats  de  leurs  recherches  avec  d’autres  personnes  de  domaines 
d’etudes  connexes.  Le  symposium  a  egalement  permis  d’informer  les  participants  des  differentes 
technologies  qui  existent  partout  dans  le  monde.  Les  systemes  visuels  des  simulateurs  ont  etes 
incapables  de  fournir  une  resolution  suffisante  pour  permettre  aux  pilotes  d’effectuer  toute  la 
gamme  des  manoeuvres  tactiques,  ni  de  fournir  les  capacites  d’entrainement  et  de  repetition  pour 
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les  operations  de  nuit.  Les  progres  realises  dans  les  technologies  de  la  projection  d’ images,  de  la 
generation  d’ images  et  de  la  photogrammetrie  ont  permis  de  remedier  a  certaines  de  ces  lacunes. 
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Figure  23.  Exemple  d’une  entree  de  la  base  de  donnees.  A  gauche,  une  orthoimage  d’origine. 

A  droite,  les  regions  d’interet  selectionnees  automatiquement,  sur  lesquelles  se 
superposed  des  symboles  geometriques  (cercle,  ellipse,  carre  triangle)  mettant  en 
evidence  un  quadruplet  qui  correspond  a  une  entree  de  la  base  de  donnees . 83 

Figure  24.  Exemple  d’un  echantillon  video.  En  haut,  un  cliche  individuel  du  survol  d’une 
partie  de  l’orthoimage  representee  a  la  figure  1.  Au  centre,  une  mosaique 
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Preface 


Realistic  and  immersive  simulations  of  land,  sea,  and  sky  are  requisite  to  the  military  use  of 
visual  simulation  for  mission  planning.  Until  recently,  the  simulation  of  natural  environments  has 
been  limited  first  of  all  by  the  pixel  resolution  of  visual  displays.  Visual  simulation  of  those 
natural  environments  has  also  been  limited  by  the  scarcity  of  detailed  and  accurate  physical 
descriptions  of  them.  Our  aim  has  been  to  change  all  that.  To  this  end,  many  of  us  have  labored 
in  adjacent  fields  of  psychology,  engineering,  human  factors,  and  computer  science.  Our  efforts 
in  these  areas  were  occasioned  by  a  single  question:  how  distantly  can  fast-jet  pilots  discern  the 
aspect  angle  of  an  opposing  aircraft,  in  visual  simulation  ?  This  question  needs  some  elaboration: 
it  concerns  fast  jets,  because  those  simulations  involve  the  representation  of  high  speeds  over 
wide  swaths  of  landscape.  It  concerns  pilots,  since  they  begin  their  careers  with  above-average 
acuity  of  vision,  as  a  population.  And  it  concerns  aspect  angle,  which  is  as  much  as  to  say  that 
the  three-dimensional  orientation  of  an  opposing  aircraft  relative  to  one’s  own,  as  revealed  by 
motion  and  solid  form.  The  single  question  is  by  no  means  simple.  It  demands  a  criterion  for 
eye-limiting  resolution  in  simulation.  That  notion  is  a  central  one  to  our  study,  though  much 
abused  in  general  discussion.  The  question  at  hand,  as  it  was  posed  in  the  nineteen-nineties,  has 
been  accompanied  by  others.  Questions  of  the  visibility  of  vehicles  and  features  of  the  landscape 
(air-to-ground  issues)  have  taken  precedence  over  questions  of  the  speed  and  direction  of  other 
aircraft  (air-to-air  issues).  Other  questions  have  arisen  about  the  visibility  and  comprehensibility 
of  landscapes  seen  by  new  spectra  (issues  of  night  vision  and  infrared  imagery)  as  well  as 
questions  of  the  geographic  fidelity  of  simulation  in  synoptic  view  (issues  of  photogrammetry  and 
mapping).  All  this  will  enable  us  to  see  better  in  simulation.  (The  answer  to  the  original 
question,  by  the  way,  is  more  than  a  couple  of  nautical  miles,  but  the  answer  will  be  elaborated 
elsewhere.  Cf.  the  chapters  by  Covas  et  al,  and  Gaska  et  al,  on  this  theme.) 

The  present  volume  began  as  the  proceedings  of  a  two-day  symposium  hosted  by  Defence 
Research  and  Development  Canada  (the  Advanced  Deployable  Day/Night  Symposium, 
November  13th  and  14th,  2007,  in  Toronto).  The  background  for  the  work  lies  in  a  long-standing 
collaboration  between  Defence  Research  and  Development  Canada  -  Toronto,  and  the  Arizona 
facility  of  the  U.S.  Air  Force  Research  Laboratory.  We  document  a  number  of  new  technologies, 
and  also  methods  for  their  evaluation.  One  may  ask  the  benefit  of  developing  advanced 
technologies,  when  often  governments  can  procure  simulation  and  display  technologies  ‘off  the 
shelf.  We  have  gathered  many  interested  parties  from  industry  and  academe,  as  can  be  told  from 
the  many  affiliations  of  the  authors  in  this  volume.  Through  our  efforts,  we  believe  we  have 
succeeded  in  nudging  North  American  industry  in  a  new  direction.  Several  of  our  concerns  - 
high-resolution  projection  and  night-vision  simulation  serve  as  examples  -  were  once  considered 
‘niche  markets’.  That  phrase  was  meant  shorthand  for  technologies  as  yet  unprofitable  for 
exploitation.  It’s  not  a  phrase  that  would  aptly  be  applied  to  these  areas  any  longer.  We  did 
predict  that  the  course  of  industrial  development  would  fill  some  gaps  in  technology,  and 
generally  we  have  been  rewarded,  with  progress  in  distributed  computing  for  simulation,  and  with 
the  development  of  small  and  reliable  solid  state  lasers  for  light  sources.  This  volume  is  a 
condensed  compilation  of  our  own  efforts,  and  their  unified  representation.  Alternate 
technologies  do  exist  in  healthy  competition  with  these,  of  course,  and  we  remain  more  attentive 
than  dogmatic  about  such  new  possibilities. 
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Industrial  production  is  unlike  engineering  is  unlike  experimental  psychology.  What  an  art  it  is, 
then,  to  balance  these  things.  It  would  be  an  exaggeration  -  it  could  be  called  a  pragmatic 
exaggeration  -  to  claim  they  can  be  complementary  in  the  business  of  simulation.  Balancing 
them  has  been  one  of  the  pleasures  of  this  enterprise,  which  does  not  end  with  the  present  volume. 
Instead  there  are  many  directions  open  for  the  future.  Here  are  some  favorites:  the  development  of 
a  four-colour  projection  system,  the  experimental  evaluation  of  sensory  substitution  for  image 
fusion,  and  the  development  of  full  atmospherics  for  night  vision  simulation.  The  first  idea  is  to 
extend  traditional  projector  systems,  which  depend  on  three  lights  such  as  red,  green,  and  blue  to 
develop  a  full  gamut  of  display  colours  in  simulation.  The  addition  of  a  fourth  channel  in  the 
near- infrared  would  enable  the  use  of  night  vision  devices  in  a  simulator  -  given  careful  attention 
to  the  simulation  of  environmental  reflectances  in  the  near  infrared.  Currently  there  are  several 
display  systems  that  are  being  developed  along  these  lines.  The  second  idea  is  to  use  sensory 
channels  to  carry  new  scenes  of  the  same  multiplicity  or  complexity,  where  a  display  is  meant  to 
represent  the  appearance  of  non-visible  parts  of  the  spectrum,  as  well  as  the  visible  scene.  The 
use  of  haptic  devices,  and  the  fused  representation  of  scenes  in  the  true  thermal  range,  are 
examples  that  have  been  put  forward,  and  which  could  well  be  elaborated  in  future.  The  third 
idea  is  that  variations  in  appearance  due  to  clouds  and  moisture  are  even  more  important  to  night 
vision  and  infrared  sensing  than  such  variations  are  within  the  ordinarily  visible  range.  The 
development  of  full  models  of  these  variations,  based  on  physical  principles,  is  then 
proportionally  important  to  the  realism  of  night  vision  simulation.  Such  an  effort  may  sound 
fairly  abstract,  until  you  want  to  find  your  way  about  when  the  weather  has  turned.  The  latter 
theme  is  developed  in  chapters  by  Clark  et  al  and  by  Zhu,  Church,  and  Labrie  in  this  volume.  As 
a  philosopher  once  prefaced  his  book:  may  others  come  along  and  improve  on  this. 
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2  Key  note  address 


2.1  Creating  Day  and  Night:  Past,  Present  and  Future 


Mary  Kaiser 

Human  Factors  Research  &  Technology  Division  of  NASA/Ames 


I  was  delighted  to  be  invited  to  delivery  the  keynote  address  at  the  Advanced  Deployable  Day/Night 
Simulation  (ADDNS)  Symposium  because  I  knew  the  other  speakers  would  present  fascinating  talks  on 
state-of-the-art  physics-based  night-vision  simulation,  ultra-high  resolution  display  technologies, 
advances  in  registering  video  imagery  with  geographic  databases,  refined  tools  and  techniques  to  measure 
performance  in  operational  scenarios,  and  the  ADDNS  system  itself  I  realized  that  I  could  add  relatively 
little  to  the  technical  discussion  of  the  latest  advances  in  these  domains.  Nonetheless,  I  hoped  that  I  could 
play  the  role  of  Janus,  the  two-headed  Greek  god  who  looked  to  the  past  as  well  as  the  future,  and  ensure 
that  the  symposium  members  considered  how  the  history  of  day/night  simulation  might  inform  our  future 
endeavors.  In  this  chapter,  I  will  summarize  my  historical  overview  and  the  insights  I  believe  we  can 
glean  from  the  road  already  traveled. 

I  began  my  review  of  the  prior  art  with  a  quotation  from  the  first  chapter  of  Genesis:  ’’And  God  said,  Let 
there  be  light:  and  there  was  light.  And  God  saw...  that  it  was  good.  And  God  divided  the  light  from  the 
darkness.  And  God  called  the  light  Day,  and  the  darkness  He  called  Night.”  I  hoped  the  audience  was 
amused  by  the  reference  (and  not  offended  -  readers  should  feel  free  to  substitute  their  preferred  creation 
account).  But  moreover,  I  hoped  the  audience  would  recognize  that  even  this  allegorical  account  touches 
on  several  important  aspects  of  creating/simulating  visual  worlds:  the  quality  of  the  resulting  product;  the 
feasibility  and  ’’share-ability”  of  the  simulation  methodology;  and  the  criteria  used  to  evaluate  the  quality 
of  the  simulation.  With  these  three  touchstones  in  hand  (Product,  Methodology,  and  Evaluation  Criteria), 
we  embarked  on  an  overview  of  ’’Day  and  Night  Simulation  in  Five  Acts.” 

2.1.1  Act  I:  Day  and  Night 

Ultimately,  the  simulation  community  would  like  its  technologies  to  support  both  daylight  and  nighttime 
conditions  with  equal  fidelity.  Historically,  systems  have  not  possessed  such  flexible  capabilities.  One 
might  suggest,  tongue  in  check,  that  the  Link  General  Aviation  Trainer  (the  infamous  ’’Blue  Box”  used  to 
train  over  a  half-million  pilots  and  aviators  during  and  after  World  War  II)  was  equally  adept  as 
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simulating  day  and  night;  but  that  is  simply  because,  as  an  instrument-conditions  trainer,  it  simulated 
contact  displays  for  neither  (Figure  la). 

It  wasn't  until  the  1990s  that  simulators  could  meet  the  visual  systems  criteria  for  FAA  Level  D  approval 
(i.e.,  "Daylight,  dusk,  and  night  visual  scenes  with  sufficient  scene  content  to  recognize  airport,  the 
terrain,  and  major  landmarks  around  the  airport  and  to  successfully  complete  a  visual  landing."  [1].  By 
mid-decade,  54  such  systems  were  operational  [2]  (for  an  enlightening  comparison,  see  CAT's  2007-2008 
Flight  Simulator  Census  of  over  1,100  full-flight  simulators  [3]).  It  is  worth  noting  that  computer 
graphics  technologies  were  able  to  meet  the  FAA's  dusk/night  visual  system  requirements  ("...4,000  light 
points  for  night  and  dusk  scenes")  years  before  they  were  capable  of  achieving  the  daylight  benchmark 
(full  color  presentation,  scene  content  comparable  in  detail  to  that  produced  by  4,000  edges  or  1000 
surfaces);  calligraphic  (vector)  devices  were  capable  of  generating  the  requisite  point  lights,  but  the 
edges/surfaces  required  for  daylight  scenes  required  later-generation  raster  technologies. 

Current  simulator  visual  systems,  such  as  Flight  Safety  International's  VITAL  Villi  (Figure  lb),  greatly 
exceed  these  graphics  generation  requirements.  Interestingly,  the  FAA  did  not  heighten  these  criteria 
when  they  last  revised  its  Advisory  Circular  on  Airplane  Simulator  Qualification  (AC  Number  120-40C); 
this  revision  has  been  in  draft  form  since  1995  [4].  Thus,  despite  the  lack  of  a  regulatory  driver, 
simulators  have  advanced  their  day/night  scene-generation  capabilities,  incorporating  advances  in 
computer  graphics  and  display  technologies. 


Figure  1.  A  collage  of flight  simulators ,  past  and  present.  Counter-clockwise  from  the  upper  left:  (a)  the 
Link  General  Aviation  Trainer;  (b)  the  B  74  7-400  simulator  at  NASA  Ames'  Crew-Vehicle  Systems 
Research  Facility;  (c)  the  Antoinette  Trainer;  and  (d)  Link's  Celestial  Navigation  Trainer. 
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2.1.2  Act  II:  Day  and  Night 

Before  possessing  the  capability  and  flexibility  computer  graphics  systems  afford,  the  simulation 
community  developed  elegant  (and  not  so  elegant)  approaches  to  visual  scene  generation.  Typically, 
these  visual  scenes  were  limited  in  scope  (e.g.,  providing  horizon  displays  to  aid  with  attitude-control 
training)  and  specific  to  daylight  or  nighttime  conditions. 

The  value  of  simulation-based  training  was  recognized  virtually  at  the  dawn  of  aviation.  In  1910,  an 
article  in  Flight  International  stated,  ’’The  invention,  therefore,  of  a  device  which  will  enable  the  novice  to 
obtain  a  clear  conception  of  the  workings  of  the  control  of  an  aeroplane,  and  of  the  conditions  existent  in 
the  air,  without  any  risk  personally  or  otherwise,  is  to  be  welcomed  without  a  doubt.”  [2].  And,  in  fact, 
innovative  aviators  were  putting  these  words  to  deed.  The  Sanders  Teacher  and  the  Antoinette  Trainer 
(a.k.a.  the  "apprenticeship  barrel”  -  Figure  lc)  were  both  introduced  that  same  year,  each  providing  the 
student  pilot  with  rudimentary  "hands-on”  exposure  to  the  mapping  between  control  input  and  change  in 
aircraft  attitude. 

Not  all  simulators  focused  on  pilotage  skills.  To  aid  WW  II  bomber  crews,  Link  developed  the  Celestial 
Navigation  Trainer  (Figure  Id).  This  elegant  (if  not  especially  compact)  trainer  recreated  with  night  sky 
with  379  point-light  "stars”  embedded  in  a  dome  that  could  rotate  and  translate  to  reflect  changes  in  time 
and  aircraft  position.  Further,  a  screen  mounted  under  the  fuselage  could  display  terrain  projections  for 
training  on  recognizing  navigational  landmarks  and  bombing  targets  [5]. 

The  Celestial  Navigation  Trainer's  creative  use  of  divergent  display  technologies  (i.e.,  both  a 
"planetarium”  dome  and  film  projectors)  reminds  us  that  the  simulation  community  often  draws  upon 
advances  in  other  disciplines  to  advance  our  own.  Nowadays,  the  most  obvious  contributions  for  visual 
systems  are  drawn  from  the  computer  graphics  and  displays  community.  Still,  it  is  informative  to 
examine  other  domains  that  have  influenced  past  simulation  technologies.  In  our  next  act,  we  will  focus 
on  techniques,  tricks,  and  tweaks  gleaned  from  cinematography  and  theme -park  rides. 

2.1.3  Act  III:  Day  for  Night 

Filming  motion  pictures  or  television  shows  at  night  is  logistically  difficult  and  expensive.  Consequently, 
cinematographers  developed  what  has  been  termed  "Day  for  Night”  (DFN)  filming  techniques  (also 
called  "La  Nuit  Americaine”  or  "American  Night,"  because  the  early  developers  were  American 
filmmakers  working  on  limited-budget  productions). 

Simply  stated,  DFN  is  the  process  of  filming  in  the  daytime  a  scene  that  occurs  at  night.  The  effect  of 
nighttime  is  accomplished  both  by  the  pattern  of  lighting  and  by  the  use  of  special  lenses  (typically  blue 
tint)  and/or  underexposure  levels  (typically  2-3  f-stops)  to  darken  the  scene  and  alter  its  hue.  There  are 
additional  heuristics  (e.g.,  shoot  under  tree-branch  shadows  to  create  the  illusion  of  moonlight,  avoid 
excessive  amounts  of  sky  in  the  frame),  but  the  technique  involves  more  art  than  science,  and  the 
resulting  quality  remain  unknown  until  the  film  is  developed. 

In  fact,  experts  in  the  field  often  disagree  about  the  effectiveness  of  the  application. 
Some  practitioners  praise  David  Lean's  "Lawrence  of  Arabia"  (1962)  as  a  paragon  of  DFN 
shooting  (e.g.,  www.digitallyobsessed.com  raves  that  the  film's  "day  for  night  scenes  look  realistic  and 
possess  outstanding  shadow  detail");  others  contend  it  is  one  of  the  worst  examples,  at  least  among  films 
with  production  budgets  greater  than  my  yearly  civil  servant  salary  (as  Mark  Smith  comments  on  www. 
cinematography.net,  "Lawrence  of  Arabia  has  some  DFN  which  perhaps  asks  us  to  suspend  a  little  too 
much  disbelief).  In  fact,  the  unusual  nature  of  the  scenery  being  "simulated"  (the  craggy  desert  landscape 
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under  full-moon  illumination  -  an  environment  often  described  as  "otherworldly”)  makes  it  difficult  for 
the  average  viewer  to  render  a  valid  fidelity  judgment. 

Actual  day-for-night  filming  is  gradually  being  displaced  with  computer-based  post-production 
processing  techniques  that  achieve  similar  effects.  The  processing  software  affords  several  advantages, 
including  allowing  the  filmmaker  to  iteratively  adjust  the  DNF  effects  and  to  apply  different  adjustments 
to  different  areas  of  the  frame  (e.g.,  greater  darkening  to  the  sky).  The  "cost”  of  migrating  to  a  post¬ 
production  methodology  is  the  lost  of  real-time  implementation;  for  cinematographers,  this  cost  is  zero  - 
DNF  is  virtually  never  applied  to  live  broadcasts.  For  the  simulation  community,  however,  real-time 
implementation  is  a  requirement  -  virtually  all  of  our  "broadcasts”  are  "live."1 

The  simulation  community  also  shares  technological  challenges  (and  solutions)  with  the  amusement  park 
industry.  One  prominent  example  of  this  is  the  increased  use  of  motion  platforms,  initially  developed  for 
flight  simulation  applications,  in  theme  rides.  Park  managers  recognize  that  motion  platforms  provide 
compelling  vestibular  cues  with  a  minimum  cost  of  valuable  staging  space.  When  properly  integrated 
with  a  visual  display,  the  resulting  immersive  experience  is  stunning  (e.g.,  the  "Soarin'  Over  California"  at 
Disney's  California  Adventure  theme  park).  Further,  park  managers  (like  simulator  users)  appreciate  the 
flexibility  motion  platforms  afford.  Just  as  NASA  Ames'  Vertical  Motion  Simulator  can  shift  its 
simulation  mode  from  Space  Shuttle  to  rotorcraft  with  a  swap-out  of  cabs  and  platform  reprogramming, 
Paramount's  Great  American  was  able  to  "re-theme"  its  motion-based  Action  FX  Theater  from  a  "Days  of 
Thunder"  car-racing  experience  to  "Stan  Lee's  7th  Portal  3D  Simulation  Experience"  (the  nature  of  which 
Pm  at  a  loss  to  explain,  even  having  experienced  it  myself). 

Prior  to  motion  platforms,  theme  rides  employed  a  "transport  the  rider  along  a  fixed  track  in  a  staged 
area"  technique.  These  "Dark  Rides"  emerged  in  the  early  20th  century  with  "Tunnel  of  Love"  and 
"Adventure  Train"  rides,  and  likely  reached  their  pinnacle  of  sophistication  in  the  Disney  parks.  "Peter 
Pan’s  Flight,"  installed  as  an  original  attraction  in  1955,  remains  one  of  the  Anaheim  park's  most  popular 
rides.  Even  today,  Disney  continues  make  major  investments  in  "Dark  Ride"  attractions  (e.g.,  the  recently 
refurbished  "Space  Mountain"  and  the  newly  opened  "Finding  Nemo  Submarine  Voyage,"  whose  track 
just  happens  to  be  under  water). 

For  over  a  decade  starting  in  the  late  1960s,  the  flight  simulation  community  at  NASA  Ames  embraced  a 
visual-scene  generation  technology  that  borrowed  both  cinematic  and  Dark  Ride  techniques  and  tricks. 
Our  Visual  Flight  Attachment  (VFA)  used  intricate  model  boards  and  a  mechanical  tracking  system  to 
"fly"  a  video  camera  over  terrains  and  airfields.  The  image  was  then  transmitted  to  the  pilot  in  the 
motion-based  simulator  cab.  Figure  2  shows  the  VFA  and  the  resulting  image  for  a  landing  approach  to 
the  model  board's  aircraft  carrier. 


1  A  notable  exception  to  real-time  visual  scene  generation  was  Link's  Variable  Anamorphic  Motion  Picture 
(VAMP).  In  this  commercial  aircraft  simulator,  full-color,  70-mm  films  were  taken  of  nominal  approach,  landing, 
and  taxi  operations.  The  VAMP  could  simulate  limited  deviations  from  the  recorded  trajectories  by  utilizing  two 
methods  of  image  processing:  (a)  subsampling  the  area  of  the  film  frame  to  correspond  to  the  aircraft's  pitch  and 
heading,  and  (b)  optically  warping  the  image  with  anamophic  lenses  to  simulate  the  aircraft's  roll.  While  the 
advantages  of  such  a  visual  system  are  apparent  (e.g.,  high  scene  resolution  and  fidelity),  the  limitations  are  equally 
striking.  Because  only  a  limited  number  of  filmed  sequences  were  available,  pilots  became  familiar  with  them  and 
started  uses  extraneous  cues  to  aid  their  pilotage  (e.g.,  using  highway  traffic  to  "time"  their  approach  trajectories). 
Further,  pilots  learned  to  null  the  optical  distortion  to  correct  their  flight  path  errors.  Clearly,  such  strategies  do  not 
generalize  to  actual  flight  environments. 
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Figure  2.  NASA  Ames'  Visual  Flight  Attachment  system  (c.  1971).  A  video  camera  (initially  black-and- 
white,  later  color)  was  mounted  at  the  rail-based  tracking  system  shown  on  the  right.  The  camera  was 
"flown  "  over  the  terrain  model  board  via  instructions  from  the  simulator  cab.  The  inset  shows  an 
example  of  the  imagery  displayed  to  the  pilot,  in  this  case  for  a  landing  approach  to  the  aircraft  carrier. 

Late  in  its  service,  the  VFA  was  adapted  for  a  series  of  simulated  night  studies  by  adding  runway  lighting 
to  the  model  board.  But  just  as  cinematographers  often  discover  during  DNF  shooting,  unanticipated 
artifacts  resulted.  Most  notably,  the  runway  lights  tended  to  ’’bloom”  on  the  video  image,  creating  false 
cues  to  distance  (i.e.,  the  runway  appeared  closer  that  it  should  during  final  approach).  One  of  the  VFA 
engineers  [6]  designed  a  dynamic  lighting  system  that  modulated  the  voltage  fed  to  the  lights  as  a 
function  of  distance  from  the  camera;  this  innovation  provided  an  effective  mitigation  again  the  blooming 
artifact.  Clearly,  Ames  engineers  can  be  just  as  clever  as  Disney’s  Imagineers. 

2.1.4  Act  III:  Day  for  Night 

As  challenging  as  simulating  natural  night  conditions  can  be,  even  more  daunting  is  simulating  the  visual 
imagery  generated  by  night  vision  devices  (NVDs),  most  notably  image  intensifying  (12)  and  infrared 
(IR)  sensors.  The  research  presented  by  others  at  this  symposium  provides  testament  to  the  advances  that 
have  transpired  in  physics-based  sensor-imagery  simulation  in  the  past  decade,  and  provides  much  greater 
insight  into  the  current  state-of-the-art  that  I  could  ever  hope.  So  what  I  shall  focus  on  instead  is  a 
simulation  technique  from  decades  past,  when  physics-based  models  were  simplistic  (or  non-existent)  and 
tended  to  overwhelm  our  graphic  systems’  real-time  processing  capabilities.  In  this  primitive  research 
environment  of  the  distant  past  (c.  1985),  we  turned  in  desperation  to  inverse  video  as  a  technique  for  IR 
simulation. 

Inverse  video  (a.k.a.  ’’reverse”  video  or  ’’reversed-polarity”  video)  simulation  method  simply  takes  a 
monochrome  video  image  and  reverses  its  polarity  (i.e.,  black  pixels  are  rendered  white,  etc.).  Because 
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this  is  a  computationally  trivial  transformation,  even  the  most  underpowered  video  board  can  handle  a 
real-time  feed.  The  resulting  image,  of  course,  portrays  none  of  the  scene's  actual  temperature  or 
radiance  properties;  it  is  simply  a  "negative"  of  the  visible  light  image.  The  question  one  must  ask,  then, 
isn't  why  inverse  video  doesn't  work  better  as  a  simulation  of  IR  imagery;  the  real  question  is:  why  does  it 
work  at  all? 

Consider  the  images  of  Comet  Tempel  1  shown  in  Figure  3  (as  a  NASA  employee,  I  am  required  to 
include  at  least  one  space-related  image  per  paper,  gratuitous  or  not).  The  left  frame  shows  a  visible  light 
image,  the  center  frame  shows  the  same  image  with  reversed  polarity,  and  the  right  frame  shows  the  IR 
image.  If  we  were  to  perform  pixel-based  analyses,  the  greatest  (albeit  negative)  correlation  would  be 
being  the  left  and  middle  images  -  a  perfect  -1.0.  The  correlation  of  the  right  image  with  the  middle  one 
would  be  in  the  neighborhood  of  0.6;  there  is  an  equal  degree  of  correlation  between  the  right  image  and 
the  left,  although  (once  again)  this  correlation  is  negative. 


Figure  3.  Three  views  of  Comet  Tempel  1  provide  a  comparison  of  visible  light  (left),  inverse  video 

(middle),  and  infrared  imagery. 

However,  this  mathematical  analysis  (at  least  the  magnitude  of  correlation)  does  not  match  our 
psychological  impression.  Perceptually,  the  middle  image  appears  much  more  similar  to  the  one  on  the 
right  than  on  the  left.  And  the  right  image  appears  similar  to  the  middle  image,  but  very  different  from 
the  left  image.  Clearly,  our  perceptual  criteria  for  similarity  are  different  from  our  mathematical  one. 
Likely,  we  are  relatively  insensitive  to  negative  correlations  (as  anyone  who's  tried  to  match  a  photograph 
to  its  proper  match  among  a  pile  of  negatives  can  attest).  Further,  it  seems  that  the  IR  and  inverse- 
polarity  images  both  disrupt  our  typical  feature-recognition  schema  and  force  us  to  engage  in  alternative, 
strategy-driven  image  interpretation.  At  some  level,  both  IR  and  inverse-polarity  imagery  share  a 
"different-ness";  this  quality  affords  the  inverse  video  simulation  technique  some  limited  training  utility. 

2.1 .5  Act  V:  Day  in  Night 

Actually,  many  additional  NASA-supplied  space  images  were  used  in  this  section  of  my  presentation,  but 
I'm  not  including  them  here  because  they  suffer  in  the  color-to-monochrome  translation.  Instead,  I 
encourage  readers  to  peruse  the  lovely  Quicktime  panoramas  Hans  Nyberg  has  assembled  from  imagery 
collected  during  the  Apollo  missions  (http://www.panoramas.dk/moon/mission-apollo.html).  One  of  the 
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most  striking  aspects  of  these  lunar  landscapes  is  how  "Day”  and  ’’Night”  co-exist  in  a  single  scene.  Due 
to  the  lack  of  atmospheric  diffusion  and  attenuation,  lighting  is  exceptionally  harsh;  shadows  are  utterly 
black.  Lawrence  of  Arabia's  moonlit  desert  crags  may  be  called  otherworldly,  but  the  Moon's  barren 
craters  truly  are:  these  ambient  illumination  conditions  are  truly  alien  to  our  terrestrially  evolved  visual 
system. 

In  order  to  perform  tasks  effectively  in  space  environments,  astronauts  need  to  train  in  high-fidelity 
simulations  of  those  environments.  To  date,  only  a  few  efforts  have  focused  on  simulating  the  visual 
conditions.  Jim  Maida's  group  at  JSC  has  developed  lighting  models  to  aid  training  for  Shuttle  EVA  tasks 
(where,  in  addition  to  dealing  with  harsh  illumination,  astronauts  must  deal  with  90-minute  day/night 
cycles).  Maida  and  his  colleagues  have  also  applied  their  models  to  simulate  what  external  cameras  will 
capture  during  the  Shuttle's  launch  and  main  tank  separation  [7],  and  have  investigate  whether 
augmented-reality  displays  can  aid  control  of  the  Shuttle's  remote  manipulator  arm  when  the  ambient 
lighting  degrades  depth  and  distance  cues  [8]. 

NASA's  current  Vision  for  Space  Exploration  calls  for  an  ongoing  human  presence  on  the  Moon 
beginning  in  the  2020's.  If  we  are  going  to  live  and  work  effectively  in  the  lunar  environment,  it  will  be 
critical  to  ensure  that  we  can  simulate  its  visual  characteristics  for  training  and  planning  exercises.  I 
invite  my  colleagues  in  the  simulation  community  to  engage  their  expertise  toward  this  next  challenging 
domain  of  visual  scene  simulation. 

2.1.6  Simulation  and  Evaluation 

Our  five-act  review  has  focused  on  two  of  the  three  touchstones  of  simulation:  the  methodologies  used  to 
create  the  simulation  and  the  resulting  product.  We  now  turn  to  the  third  touchstone:  evaluating  the 
simulation  quality.  In  my  Genesis  example,  the  resulting  "Day”  and  "Night”  were  deemed  "Good”  by  a 
single  (albeit  highly  respected)  evaluator.  In  the  simulation  community,  even  today,  significant  weight 
can  be  placed  on  the  "goodness”  judgment  of  a  single  esteemed  evaluator,  be  it  a  test  pilot, 
astronaut,  or  multi-starred  general  (none  of  whom,  technically,  is  God  or  even  godlike...  despite  rumors  to 
the  contrary). 

The  Genesis  evaluation  process  can  also  be  criticized  for  allowing  the  designer  -  not  a  terribly  objective 
party  -  to  judge  the  product's  effectiveness.  The  designer's  lack  of  objectivity  is  not  due  simply  (or  only) 
to  their  personal  investment  in  the  project.  In  addition,  their  intimate  knowledge  of  the  simulation's 
intended  purpose  can  prevent  them  from  evaluating  the  product  with  the  "naive”  eye  of  the  user.  The 
Genesis  example  also  points  to  the  most  critical  aspect  of  evaluation:  what  is  the  function  of  the  world 
we've  created?  In  order  to  determine  whether  a  simulation  is  of  sufficient  fidelity,  we  must  first 
understand  the  function  it  must  support. 

For  filmmakers,  the  world  they  create  is  there  to  support  the  story  they  wish  to  tell.  Any  cinematic 
technique  that  is  used  to  simulate  conditions  in  that  world  is  acceptable  so  long  as  it  does  not  overly  tax 
the  audience's  willing  suspense  of  disbelieve  and  thereby  "yank  them  out  of  the  story.” 

For  theme-ride  designers,  the  world  is  there  to  support  the  adventure  of  the  ride.  Generally,  it  is  difficult 
to  tell  a  complex  story  in  the  course  of  the  ride  (as  both  Stan  Lee  and  the  early  designers  of  Disney's 
"Pirates  of  the  Caribbean”  discovered);  rather,  the  goal  is  to  provide  a  global  sense  of  experience  (e.g., 
hang  gliding  in  "Soarin’  Over  California”  or  rocket  riding  in  "Space  Mountain”)  or  to  immerse  the  rider  in 
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the  key  scenes  of  a  familiar  tale  (e.g.,  Disney's  "Pinocchio's  Daring  Journey"  and  "Peter  Pan's  Flight"). 
So  long  as  the  rider  enjoys  and  "gets"  the  experience,  the  simulated  world  has  achieved  its  purpose.2 

For  the  training  simulation  community,  the  evaluation  bar  is  set  higher.  Our  goal  is  to  ensure  that  the 
skills  and  strategies  acquired  in  the  simulated  world  will  generalize  to  performance  in  the  real  world. 
How,  then,  do  we  evaluate  the  quality  of  the  simulation  to  determine  whether  this  goal  is  achieved? 

Similar  to  filmmakers  and  ride  designers,  our  community  utilizes  subjective  evaluations  from  expert 
raters.  Such  subjecting  ratings,  in  fact,  still  play  a  role  in  FAA  certification  processes  [1,  4].  However, 
these  expert  evaluators  are  typically  (and  properly)  users  rather  than  designers,  and  they  are  asked  to  rate 
the  degree  of  simulation  between  the  simulation  and  the  actual  vehicle  or  system.  On  the  positive  side  for 
our  community,  a  clear  standard  (i.e.,  the  real-world  vehicle  or  system)  can  be  provided;  on  the  negative 
side,  it  is  still  uncertain  what  criteria  the  evaluator  employs  in  making  a  judgment  of  perceived  similarity. 

A  second  class  of  evaluation  employed  by  the  simulation  community  is  based  on  measuring  operational 
performance.  If  we  can  establish  performance  criteria  (and  acceptable  levels  thereof),  we  can  access 
similarity  of  operators'  performance  in  the  simulator  to  their  performance  with  the  actual  vehicle  or 
system.  Also,  we  can  evaluate  the  extent  to  which  operational  training  generalizes  from  simulator  to  real- 
world  performance.  The  limitation  of  this  evaluation  methodology  is  its  cost  (extensive  real-world 
performance  must  be  conducted  and  evaluated),  and  the  fact  that  it  can  only  be  applied  as  a  post-hoc 
evaluation:  we  need  an  existing  simulator  to  evaluate. 

Ideally,  our  community  would  like  to  be  able  to  establish  objective  metrics  of  simulator  quality  and 
fidelity.  Such  metrics  can  then  be  applied  both  to  the  evaluation  of  existing  systems  and  to  the 
development  of  design  requirements  for  future  systems.  I  now  consider  two  areas  where  such  objective 
metrics  could  be  established:  image  quality  evaluation  of  physics-based  modeling  and  simulation;  and 
psychophysics-based  evaluation  of  visual  systems. 

Following  my  talk  at  the  symposium,  Richard  Wildes  asked  for  examples  of  where  physics-based 
simulation  is  inadequate.  In  principle,  a  complete  physics-based  simulation  would  be  fully  adequate. 
But,  of  course,  even  with  modern  computational  capabilities,  it  is  not  possible  to  employ  complete 
physical  models.  Rather,  we  model  those  aspects  that  critically  impact  the  visual  simulation.  So  it's  the 
question  is  not  whether  to  start  with  physics-based  modeling;  the  question  is  when  one  can  stop 
the  modeling  process  -  when  is  the  image  that  results  from  the  model  perceptually  equivalent  to 
the  true  image? 

Assuming  that  we  can  assemble  a  set  of  true  images  that  adequately  samples  the  visual  world,  we  can 
examine  observers'  ability  to  discriminate  between  the  true  and  simulated  images.  Alternatively,  we  can 
apply  a  human  vision  model  such  as  the  Spatial  Standard  Observer  [9]  to  measure  this  discriminability 
without  the  need  to  perform  the  tedious  psychophysical  assessments. 

Where  psychophysics  is  needed  is  to  develop  the  general  visual  system  requirements  -  and  the  best 
psychophysics  to  use  is  active  psychophysics.  Sweet  has  developed  a  useful  taxonomy  that  maps 
potential  visual  depth  cues  (e.g.,  convergence,  binocular  disparity,  motion  parallax,  linear  perspective, 
occlusion)  to  the  relevant  component  of  the  visual  system  (i.e.,  the  image  generator,  the  display,  or  both), 
and  determines  whether  or  not  veridical  cues  are  provided  [10].  In  the  case  of  the  display  component,  the 

2  As  already  suggested,  designers  are  not  always  the  best  judge  of  whether  the  simulation  is  successful.  Disney's 
Imagineers  originally  designed  "Peter  Pan's  Flight"  as  a  first-person  theme  ride;  that  is,  the  rider  was  Peter  Pan. 
Audiences  loved  the  ride,  but  would  frequently  ask,  "Where  was  Peter?  We  never  saw  him!"  Finally,  park 
managers  conceded  that  riders  were  not  "getting"  the  first  person  perspective,  and  added  an  Audio-Animatronic 
Peter  in  1983. 
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quality  of  depth  cueing  can  vary  as  a  function  of  the  display  type  (e.g.,  collimated  screens  do  not  provide 
proper  motion  parallax  cues  due  to  pilot  head  movements,  but  head-tracked  stereo  displays  can). 
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Figure  4.  An  n active  psychophysics "  model  of  inner-loop  control  [11]. 

The  next  step  in  the  process  is  to  determine,  for  a  given  operational  task,  what  visual  cues  are  required  for 
success  execution  of  the  inner-loop  control  task  (see  Figure  4).  One  can  then  map  the  operational  training 
needs  into  simulator  design  requirements,  recognizing  that  these  requirements  may  be  task  specific.  For 
example,  mid-air  refueling  will  likely  impose  different  visual  requirements  (e.g.,  near-field  depth  cues) 
than  open-sky  target  acquisition  (e.g.,  high  resolution  and  wide  fields  of  view).  Given  our  current 
simulation  technology,  the  goal  is  not  so  much  to  design  The  Perfect  Simulator,  but  rather  to  enable  a 
cost-effective  match  of  requirements  and  design. 

At  some  level,  this  task-specific  approach  to  simulator  design  may  seem  to  put  us  back  into  the  barrel 
with  Antoinette's  apprentices.  I  would  argue,  however,  that  the  sophistication  of  our  current  simulation 
technologies  allows  us  to  build  cost-effective  systems  that  are,  in  fact,  fully  sufficient  for  wide  classes  of 
tasks.  Still,  we  must  recognize  that  even  FAA-certified  full-mission  simulators  have  less-than-desired 
fidelity  for  some  phases  of  flight  (e.g.,  taxi  and  ramp  operations). 

I  believe,  therefore,  that  the  best  lessons  to  be  learned  from  the  history  of  flight  simulation  (and  related 
domains)  is  one  that  was  taught  in  Antoinette's  trainer:  maintaining  a  proper  balance.  But  the  balance  our 
community  seeks  is  among  cost,  flexibility,  and  fidelity:  how  do  we  best  exploit  available  technologies  to 
design  affordable  simulators  that  can  simulate  the  widest  range  of  task  scenarios  at  the  requisite  level  of 
fidelity?  It  is  a  challenging  undertaking,  which  is  why  I  was  pleased  to  be  surrounded  by  such 
impressively  able  colleagues  at  the  ADDNS  symposium. 
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3.1  Development  of  a  DVI-compatible  VGA  projector  engine  based 
on  flexible  reflective  analog  modulators  (FRAM) 
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Introduction:  The  development  of  a  Digital  Video  Interface  (DVI)  compatible  VGA  projector  engine 
based  on  Flexible  Reflective  Analog  Modulator  (FRAM)  is  reported.  The  FRAM  technology 
development  began  a  few  years  ago  [12,13,14,15]  in  response  to  a  need  for  a  new  projection  technology 
allowing  the  achievement  of  ultrahigh  resolution  for  high  fidelity  simulations.  This  technology  relies  on 
simple  micromirrors  produced  using  typical  Micro  Opto  Electro  Mechanical  System  (MOEMS) 
manufacturing  processes.  It  has  the  advantages  of  offering  a  simple  fabrication  process  (3  masking 
layers),  a  quick  response  time  (lower  than  5s)  and  to  be  wavelength  insensitive  over  large  spectral  ranges. 
Additionally,  the  light  modulation  with  these  microdevices  does  not  require  the  achievement  of  a  very 
high  quality  optically  flat  state  of  the  micromirrors  which  is  typically  difficult  to  obtain  yet  necessary  for 
other  MOEMS  modulation  technologies. 

Testing  and  FRAM  array  selection  for  packaging:  One  main  challenge  of  the  projector  engine 
development  was  the  packaging  of  the  FRAM  dies  presenting  a  high  number  of  input  signals  (481).  For 
the  packaging  of  such  dies,  the  dieonboard  approach  was  selected.  480  x  1  FRAM  arrays  appropriate  for 
this  packaging  approach  have  been  designed,  fabricated  and  tested  (Figure  1).  Very  large  arrays  (4000x1) 
(Figure  2)  were  also  produced  within  the  fabrication  run  therefore  confirming  the  feasibility  of  such 
arrays.  Testing  in  itself  represented  a  challenge.  Actually,  it  was  critical  to  select  a  480  x  1  FRAM  array 
with  a  pixel  functionality  percentage  as  high  as  possible  to  minimize  the  presence  of  dead  rows  in  the 
projected  image.  Reaching  this  goal  implied  that  the  fabricated  FRAM  arrays  should  be  carefully 
inspected  and  tested.  In  practice,  testing  all  FRAMs  of  many  480  x  1  arrays  before  packaging  is  not 
straightforward.  The  difficulty  here  is  that  the  time  and  cost  required  for  such  testing  must  remain 
reasonable.  This  requires  many  FRAMs  to  be  activated  and  tested  at  once.  Activation  of  many  FRAMs 
(60)  was  achieved  with  a  customized  probe  card  combined  to  a  probe  station.  The  response  of  the 
activated  FRAMs  was  observed  with  an  optical  test  bench  integrated  to  the  probe  station.  This  test  bench 
was  a  small  and  slightly  modified  version  of  the  optical  system  used  in  a  projector.  A  line  of  light 
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illuminated  a  number  of  FRAMs  and  the  light  reflected  by  the  FRAMs  passed  through  Schlieren  optics  to 
produce  pixels  in  the  image  plane  located  at  the  exit  of  an  optical  relay.  A  camera  and  a  CRT  produced  a 
magnified  image  of  the  pixels.  This  provided  a  convenient  method  for  assessing  the  functionality  of 
thousands  of  FRAMs  relatively  quickly  by  observing  the  pixels  intensity  changes  as  the  voltage  applied  to 
the  FRAMs  was  varied. 

FRAM  array  packaging:  One  480  x  1  FRAM  array  has  been  selected  for  final  packaging  using  this 
method  combined  with  complementary  interferometric  microscope  measurements.  A  flex  board/metallic 
package  assembly  has  been  used  to  implement  the  selected  dieonboard  packaging  approach  (Figure  3). 
Within  the  assembly,  each  FRAM  is  electrically  connected  to  the  flexible  PCB  using  wire  bonding.  A 
housing  placed  over  the  FRAM  array  and  clamped  to  the  board  provides  an  hermetic  enclosure  allowing 
operation  of  the  FRAM  array  in  an  inert  atmosphere  of  dry  Nitrogen.  It  also  provides  mechanical 
protection  to  the  array.  It  is  equipped  with  an  optical  window.  Small  closable  inlet  and  outlet  openings 
allow  regeneration  of  the  inert  atmosphere  if  necessary. 


Figure  5.  FRAM  arrays  with  a  membrane  thickness  of 300  nm. 
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Control  electronics,  software  and  final  assembly:  The  link  between  the  dieonboard  packaging 
assembly  and  the  control  electronics  is  insured  by  standard  high  pin  count  connectors.  This  customized 
control  electronics  and  the  associated  control  software  have  been  developed  to  allow  the  transfer  of  image 
data  to  the  modulator  array.  The  control  electronics  includes  a  DAC  board,  a  FPGA  board  and  a  power 
supply  board.  The  designed  electronics  and  the  associated  software  are  compatible  with  the  Digital  Video 
Interface  standard.  This  allows  the  projection  of  a  variety  of  images  including  still  images  and  animated 
sequences.  With  the  resulting  projector  engine,  images  with  VGA  resolution  can  be  displayed  at  a  frame 
rate  of  60  Hz. 

Part  of  the  control  electronics  and  the  package  assembly  are  mounted  on  positioning  supports.  These 
supports  allow  a  precise  optical  alignment  of  the  FRAM  array.  Full  functionality  of  the  engine 
has  been  verified  by  integrating  it  (Figure  4)  into  an  existing  optical  test  bench  and  projecting  still  images 
and  animations. 


Figure  8.  The  projector  engine  and  part  of  the  optical  test  bench. 
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Brightness  and  contrast  of  images  projected  by  laser  based 
video  projectors 
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Introduction:  Laser  based  video  projectors  (LBVP)  are  relatively  new  on  the  scene  of  video  display. 
LBVPs  consist  of  laser  beams  that  are  scanned  and  synchronously  modulated.  An  important 
characteristic  of  the  LBVP  is  the  very  short  lifetime  of  the  pixels.  Each  pixel  produces  light  only  for  the 
very  short  time  during  which  the  laser  beam  passes  on  it.  The  short  transients  make  the  measurement  of  a 
LBVP  image’s  properties  more  difficult  to  obtain  in  comparison  to  conventional  display  devices.  The 
validity  of  the  results  is  even  questionable  when  conventional  methods  are  used  to  measure  the 
characteristics  of  LBVP  images.  This  paper  presents  an  alternative  method  for  the  characterization  of 
brightness  and  contrast  of  LBVP  images  that  is  expected  to  provide  more  reliable  results. 

Conventional  method:  Conventionally,  the  measurement  of  the  brightness  and  contrast  of  a  display  is 
done  using  a  telephotometer.  As  its  name  indicates,  the  telephotometer  allows  the  measurement  of  light 
from  a  distant  position.  The  telephotometer  consists  of  an  imaging  lens  that  projects  the  image  of  the 
scene  on  a  detector  and  pupils  used  to  define  the  envelope  of  the  effective  input  beam  of  light.  In  the 
context  of  display  characterization,  the  telephotometer  is  pointed  on  a  small  part  of  the  display  screen  and 
it  collects  rays  coming  from  this  observation  zone.  Only  a  fraction  of  the  optical  power  reaches  the 
detector  of  the  telephotometer.  In  the  case  of  LBVP,  the  optical  signal  is  difficult  to  measure  since  it  is 
relatively  weak  and  contains  rapid  transients. 

Proposed  alternative  method:  A  rapidly  varying  optical  signal  can  be  measured  accurately  provided  that 
it  is  strong  enough.  In  order  to  facilitate  the  measurements  of  the  characteristics  of  the  LBVP  images,  the 
detection  paradigm  must  be  changed  in  order  to  ensure  a  stronger  optical  signal  on  the  photodetector.  The 
proposed  alternative  method  aims  at  achieving  this  goal.  This  alternative  method  involves  measuring  the 
irradiance  (optical  power  per  unit  surface)  in  the  plane  before  the  screen.  The  radiance  or  luminance  is 
then  determined  by  computation  using  the  measured  reflectivity  properties  of  the  screen. 

In  the  proposed  method,  the  irradiance  is  measured  at  different  points  in  the  plane  or  surface  located 
immediately  in  front  of  the  surface  normally  occupied  by  the  screen.  The  test  pattern  proposed  for  the 
measurement  is  a  10  by  10  chessboard.  The  irradiance  measurement  is  performed  in  the  middle  of  each 
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bright  square.  For  each  sampling  position,  a  first  measurement  is  performed  for  the  maximum  value  of 
irradiance,  and  a  second  one  is  performed  for  the  minimum  value  with  a  reverse  video  test  pattern. 

Some  modern  screens  possess  microstructures  allowing  control  of  the  directional  scattering  properties. 
For  such  screens,  the  scattering  properties  generally  depend  on  the  illumination  direction.  The 
mathematical  representation  of  the  screen’s  reflectivity  properties  that  is  used  for  the  luminance 
computation  is  the  Bidirectional  Reflectance  Distribution  Function  (BRDF)  [16].  The  BRDF  gives  the 
reflected  radiance  per  unit  of  incident  irradiance  for  any  reflection  direction  and  any  illumination 
direction.  Specialized  devices  exist  that  allow  the  efficient  measurement  of  the  BRDF  spectral 
distribution.  The  method  involves  that  a  part  of  screen  be  sacrificed  for  the  BRDF  measurement.  Having 
the  spectral  BRDF  of  the  screen  and  a  sampling  of  the  screen  irradiance,  the  luminance  may  be 
determined  for  any  observer  position  and  any  point  on  the  screen  using  a  dedicated  computer  program. 


Figure  9.  Schematic  description  of  the  method. 

Practical  considerations:  Many  practical  considerations  should  be  addressed  for  the  implementation  of 
the  proposed  method.  Parasitic  light  may  have  significant  impact  on  the  results.  Both  spatial  and  temporal 
samplings  of  the  optical  signal  may  also  introduce  measurement  error  if  they  are  not  done  conveniently. 

Parasitic  light  is  generated  both  by  the  projector  itself  and  by  the  environment.  The  veiling  glare  comes 
from  the  undesirable  reflections  on  the  lens  surfaces  and  on  mechanical  parts  of  the  projector.  It  increases 
with  the  total  amount  of  optical  power  contained  in  the  projected  image.  The  ambient  illumination  and  the 
back  reflection  on  walls  and  objects  are  the  two  main  sources  of  parasitic  light  generated  by  the 
environment.  Such  parasitic  light  is  environment  dependent.  Parasitic  back  reflection  occurs  when  light 
coming  from  the  screen  is  reflected  back  toward  it  by  walls  and  objects.  The  parasitic  light  considerably 
affects  the  image  contrast  since  it  adds  a  background  intensity  on  the  screen.  The  10  by  10  chessboard  test 
pattern  was  chosen  in  order  to  generate  the  unavoidable  veiling  glare  that  is  representative  of  a  normal 
image.  Such  test  pattern  contains  about  half  of  the  maximum  available  optical  power  and  generates  about 
half  of  the  maximum  possible  veiling  glare.  Choosing  a  pattern  with  less  optical  power  would  reduce  the 
amount  of  veiling  glare  and  result  in  an  estimated  contrast  not  representative  of  the  contrast  for  a  normal 
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image.  The  signal  deterioration,  due  to  environment  parasitic  light,  changes  with  the  configuration  of  the 
projection  room  and  this  is  a  problem  for  standard  measurement.  Fortunately,  simple  techniques  exist  to 
overcome  these  problems.  The  contribution  of  the  environment  dependent  parasitic  light  may  be 
measured  and  then  subtracted  from  the  useful  signal  [17],  which  is  accomplished  by  putting  the 
photodetector  in  the  shadow  of  a  black  opaque  mask.  The  light  from  the  projector  (including  the  veiling 
glare)  is  blocked  and  only  the  ambient  illumination  and  the  parasitic  back  reflection  can  reach  the 
photodetector. 

The  sampling  process  required  for  -any  measurement  must  be  adapted  to  take  into  account  the  spatial 
distribution  as  well  as  the  temporal  fluctuations  of  the  phenomenon  to  be  characterized.  In  the  case  of  a 
LB  VP  image,  care  must  be  taken  to  avoid  problems  related  to  the  pixelization  of  the  image  and  fast 
variations  due  to  scanning.  Depending  on  the  LBVP  technology,  there  can  be  dead  zones  in  between 
pixels  or  inside  each  of  them.  Such  periodic  structures  may  induce  measurement  errors  when  the  detector 
dimensions  do  not  include  an  integer  number  of  structure  periods.  Depending  on  the  relative  position  of 
the  photodetector  with  respect  to  the  pixel  array,  more  or  less  dead  zones  are  included  in  the  effective  area 
of  the  detector.  This  means  that  the  signal  is  dependent  on  the  detector  position  with  respect  to  the  pixel 
lattice.  These  potential  spatial  sampling  problems  can  be  avoided  if  simple  rules  are  respected.  These 
rules  concern  the  number  of  pixels  contained  within  the  detector’s  effective  surface,  the  shape  of  the 
detector,  and  its  orientation  with  respect  to  the  pixels. 
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3.3  Physics  based  modeling  and  simulation  of  light  sources 
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^ Presented  paper  (photograph  below) 


Light  sources  inherent  in  urban  populations,  battlefield  effects,  and  vehicles  are  the  dominant  features  in  a 
simulated  night  scene.  The  effectiveness  of  optical  sensors  in  these  environments  is  positively  or 
negatively  affected  depending  upon  the  quantity,  type,  power,  placement,  housing,  and  orientation  of 
these  sources.  Yet,  traditional  simulation  techniques  have  focused  little  on  the  accurate  representation  of 
light  sources  and  their  interaction  with  other  scene  elements.  Traditional  lightpoint  rendering  techniques, 
while  addressing  modest  out-the-window  training  requirements,  fall  well  short  of  recreating  the 
challenges  associated  with  the  employment  of  image  intensifying  sensors  for  situational  awareness  in 
today’s  complex  mission  environments.  The  elevated  priority  of  low-altitude,  urban  missions  such  as 
close  air  support  (CAS)  and  combat  search  and  rescue  (CSAR)  will  require  richer,  more  accurate,  and 
more  dense  representations  of  light  sources  if  the  sensor-related  elements  of  these  missions  are  to  be 
trained  in  simulators. 

Leveraging  related  research  and  development,  ADDNS  Phase  II  development  efforts  will  integrate  point 
source  modeling  techniques  pioneered  under  collaborative  research  and  development  co-sponsored  by 
USAF,  AFRL/HEA  and  USN,  NAVAIR  PMA-205.  The  presented  paper  will  summarize  the  core 
concepts  employed  to  model  urban  lighting  with  the  density  and  accuracy  desired  for  sensor  training 
applications.  Secondly,  a  proof-of-concept,  open  architecture  XML  storage  structure  for  point  source 
modeling  parameters  will  be  summarized.  Finally,  the  results  of  these  techniques  will  be  presented  in  an 
application  example  demonstrating  the  offline  prediction  of  point  source  types,  power,  and  location  from 
remote  sensing  data  as  well  as  the  production  of  physics-based  terrain  irradiance  maps  for  simulation. 


20 


DRDC  Toronto  TR  2009-121 


4  Image  generation 


4.1  Integration  of  a  deployable  CIGI-based  IG  in  an  existing 
simulation 
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An  image  generation  system  delivers  the  principal  imagery  in  visual  simulations.  It  may  be  split  into  its 
constituent  software  (image  generator)  and  hardware  (display)  components.  The  image  generator  supplies 
both  image  rendering  functions  as  well  as  informational  mission  functions.  The  system  is  often 
characterized  by  its  ability  to  provide  a  certain  frame  rate  for  a  given  image  resolution,  scene  complexity, 
and  latency.  The  ADDNS  project  has  produced  an  advanced  image  generator  (IG)  for  flight  simulation 
known  as  the  Eagle  IG.  The  large  screen  and  visual  acuity  resolution  of  the  Evans  and  Sutherland  laser- 
based  projector  display  make  this  system  one  of  the  first  of  its  kind.  The  Eagle  IG  is  based  upon  Multigen 
FlightIG  image  generation  software,  providing  a  networkbased  interface  based  upon  the  Common  Image 
Generator  Interface  (CIGI).  Here  we  discuss  issues  of  the  demonstration  integration  of  the  new  IG,  using 
CIGI,  with  the  existing  Advanced  Distributed  Mission  Training  (ADMT)  MultiTask  Trainer  (MTT)  for 
the  Cl 8,  located  at  DRDC  Toronto.  In  normal  operations,  the  MTT  employs  a  multichannel  MetaVR 
image  generation  system  which  display  over  eight  flat  projector  screens  in  a  dome  arrangement. 

CIGI  is  a  networkbased  protocol  created  by  Boeing  that  defines  the  format  and  content  of  CIGI  packets 
but  does  not  define  how  they  are  transmitted  across  a  network.  Boeing  publicly  released  its  original  CIGI 
SDK  in  2001  to  promote  the  use  of  an  open  image  generator  interface  for  visual  simulation.  Development 
of  CIGI  support  software  continues  today  in  the  open  source  community.  CIGI  originates  in  the  IG, 
perhaps  based  on  the  philosophy  that  absolute  frame  borders  in  the  IG  are  fixed  or  very  difficult  to  change 
given  features  such  as  genlocking.  Ideally,  the  Host  must  be  able  to  respond  to  the  IG  with  the  data 
appropriate  to  the  IG  frequency. 

There  are  a  myriad  of  issues  that  complicate  the  integration  of  any  host  simulation  with  an  IG.  These 
issues  are  complex  when  integrating  with  a  host  that  is  changing  from  one  IG  to  another  and  more  so 
when  integrating  sidebyside  in  a  heterogeneous  IG  system.  The  approach  taken  for  integrating  the  Eagle 
IG  with  the  MTT  is  to  create  a  sidebyside  demonstration  of  the  usual  MTT  visual  with  a  replicated  front 
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channel  on  the  Eagle  IG  using  CIGI  protocol  to  control  the  viewpoint  only.  A  generic  analytical  approach 
for  facilitating  the  integration  includes  scoping  the  existing  IG  installation,  comparing  with  the  new  IG 
protocol,  and  substituting  appropriate  host  information  and  messages  in  the  new  protocol.  The  complete 
integration  of  the  MTT  with  the  Eagle  IG  is  far  more  complex  than  viewpoint  integration  and  well  beyond 
the  scope  of  this  work.  The  process  of  integration  follows  the  steps  of  comparison  of  native  MTT  graphics 
messages  with  equivalent  CIGI  messages  (which  could  be  used  to  scope  complete  MTT  integration),  the 
assembly  of  well  ordered  CIGI  API  source  code  calls,  and  the  inclusion  of  MTT  data  in  the  CIGI 
messages. 

To  facilitate  the  integration,  a  sidebyside  of  CIGI  equivalents  to  the  ChannelSurfer  messages  used  by  the 
MTT  was  prepared.  The  important  parameters  of  each  of  the  CIGI  Advanced  Deployable  Day  Night 
Simulation  Symposium  message  types  are  indicated.  For  ChannelSurfer  messages,  it  is  indicated  if  the 
message  is  of  a  generic  type  (header  only),  a  minimum  requirement  for  ChannelSurfer  communications, 
or  a  corresponding  message  for  completion  of  the  protocol  exchange.  Pseudosource  code  fragments 
demonstrate  the  sequence  of  CIGI  calls  required  in  communication  with  any  IG.  The  calls  are  based  on 
the  freely  available  Boeing  CIGI  software,  the  same  code  exploited  by  Multigen  to  create  their  own  host 
emulation  application  for  FlightIG  software.  Additional  pseudocode  snippets  demonstrate  the  integration 
of  MTT  values  with  the  properly  sequenced  CIGI  calls  within  the  MTT  software. 

Different  issues  that  may  have  complicated  or  facilitated  the  integration  process  are  also  discussed. 
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4.2  Advances  in  scalable  generic  image  generator  technology  for 
the  Advanced  Deployable  Day/Night  Simulation  (ADDNS) 
Project 
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The  Advanced  Deployable  Day/Night  Simulation  (ADDNS)  Technology  Demonstration  Project  (TDP) 
contained  a  critical  requirement  for  at  least  16  synchronized  Image  Generators  (IGs)  to  render  scenes  at 
60  Hz  for  a  greater  than  20  million  pixel  Ultra-High  Resolution  laser  projection  system. 

Array  Systems  Computing  Inc.  (Array)  adapted  its  advanced  ScalableGSP  (Generic  Signal  Processor) 
architecture  to  satisfy  the  ADDNS  requirements.  This  scalable  generic  IG  solution  is  described  in 
the  paper. 

The  Array  ADDNS-IG  solution  is  composed  of  a  16-node  Personal  Computer  (PC)  Linux  cluster 
configuration,  with  each  PC  consisting  of  integrated  Commercial  Off-the-Shelf  (COTS)  hardware, 
featuring  multiple  Opteron  Central  Processing  Units  (CPUs),  NVIDIA  graphics  cards,  and  supporting 
components. 

To  operate  the  hardware  and  use  distributed  rendering,  Array  integrated  Multigen-Paradigm  Inc.  (MPI)’s 
Flight-IG  runtime  software  and  the  Common  Image  Generator  Interface  (CIGI)  under  Centos  Linux. 

During  the  development  of  the  Array  ADDNS-IG,  a  number  of  engineering  and  design  challenges  were 
overcome.  The  final  solution  includes  the  following  features: 

1.  In  order  to  seamlessly  display  greater  than  20  million  pixels  on  the  laser  projector  at  60  Hz,  the 
individual  IGs  were  synchronized  globally  to  within  10  milliseconds  by  both  genlock  and  framelock, 
using  special  hardware  and  software.  Verification  and  validation  of  this  requirement  involved 
detailed  testing  and  strict  configuration  control. 

2.  The  system  required  portability  and  a  limited  environmental  footprint.  A  space  saving  design  for  each 
IG  was  developed  to  address  these  requirements.  These  solutions  involved  developing  and 
implementing  methods  of  fitting  the  components,  reducing  the  power  consumption,  and  reducing 
noise  and  heat. 
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3.  The  IG  system  was  designed  to  interface  with  other  systems  operating  under  open  architecture  and 
standards.  This  was  achieved  by  using  the  open  source  CIGI  protocol,  COTS  components,  and  the 
Centos  Linux  distribution.  The  IG  system  was  also  designed  to  support  future  requirements  of 
interfacing  with  other  networks  using  Distributed  Interactive  Simulation  (DIS)  and  High-Level 
Architecture  (HLA)  protocols. 

4.  The  mandatory  4x4  Tiling’  of  16  Digital  Video  Interface  (DVI)  inputs  for  the  display  system’s  full 
scene  display  at  runtime  required  distributed  rendering  using  advanced  networking  techniques  in 
Linux  including  multicasting  and  host-input  synchronization,  in  a  Master-Slave  node  configuration. 

5.  The  system’s  cost  and  operational  requirements  implied  the  use  of  generic,  easily  replaceable  COTS 
components,  including  modern  graphics  cards  with  advanced  Graphics  Processing  Units  (GPUs). 


Additional  enhancements  currently  being  developed  for  the  IG  system  include  boot-off-network  diskless 
slaves,  a  fully  integrated  network  backup  server,  and  an  updated  operating  system  build  (Centos  5). 
These  enhancements  enable  a  reduction  in  the  number  of  hard  drives  in  the  cluster  from  18  to  3, 
simplifying  the  configuration  and  backup  of  the  system,  while  also  reducing  the  number  of  hard  drives  to 
be  secured  in  the  future  use  of  classified  data. 

Array  has  developed  and  deployed  a  modern,  COTS  based,  open  architecture,  scalable  generic  image 
generator  system  for  ADDNS.  This  IG  system  can  be  easily  upgraded  and  expanded  to  address  more 
demanding  future  applications,  such  as  cockpit  flight  simulator  displays,  and  higher  resolution  laser 
projectors.  Future  challenges  include  further  reducing  network  latency,  and  increased  graphics  card 
resolution  to  support  next  generation  high  resolution  laser  projectors. 
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Abstract:  Networked  flight  simulators  facilitate  team  training  by  creating  exercise  environments  and 
simulations  representative  of  real-world  operations.  However,  networked  simulators  are  often  plagued  by 
connectivity  issues,  such  as  constant  and  variable  network  delay.  Network  delay  can  cause  positional 
discrepancies  or  visual  jitter  in  the  flight  path  of  a  moving  model  which  could  effect  pilots  overall 
perception  of  fidelity  of  motion.  To  reduce  the  visibility  effects  of  network  delay,  image  generator 
algorithms,  such  as  model  position  smoothing,  can  be  enabled.  The  use  of  smoothing  however,  can  also 
contribute  to  error  in  the  motion  path  of  an  entity.  This  research  aims  to  determine  the  detection  threshold 
of  visual  displacement  for  a  typical  flight  task,  formation  flight,  as  a  function  of  simulated  distance  (100, 
200,  &  400  meters)  and  smoothing  (no  smoothing  or  smoothing  across  1  second).  The  results  show  a 
significant  increase  in  detection  threshold  with  increases  in  distance.  The  addition  of  model 
position  smoothing  also  increased  the  amount  of  visual  displacement  required  for  detection.  The 
implications  of  these  results,  as  well  as  plans  for  future  research  on  network  transport  delay  will  also  be 
discussed  in  this  paper. 

Introduction:  To  provide  a  realistic  team-training  environment,  simulators  are  networked  enabling 
trainees  to  perform  exercises  emulating  real-world  conditions.  When  simulators  are  networked, 
especially  over  large  geographical  areas,  interactions  between  them  become  more  complicated. 
According  to  Toet  three  important  issues  related  to  the  realism  of  time  must  be  considered  when 
networking  simulators  [18].  These  issues  concern  the  timing  consistency  of  the  virtual  world,  delays,  and 
the  overall  representation  of  time  in  a  simulator. 

The  level  of  realism  of  an  entity  in  a  networked  simulator  depends  upon  factors  such  as  network  delay, 
thresholds  used  to  determine  when  a  simulated  position  error  should  be  corrected,  and  algorithms  used  to 
correct  position  errors.  These  factors  can  interact  and  produce  positional  discrepancies  between  the 
position  provided  by  a  local  model  of  an  entity,  which  is  used  to  render  the  entity,  and  the  actual  position 
of  the  entity.  The  correction  of  positional  discrepancies  via  the  use  of  smoothing  within  the  Image 
Generator  (IG)  results  in  a  positional  displacement  of  the  rendered  entity  [19].  The  purpose  of  this 
experiment  was  to  assess  the  detection  threshold  of  positional  error  or  displacement  threshold  as  a 
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function  of  distance  from  eyepoint,  and  positional  smoothing  performed  by  the  IG.  This  data  will 
contribute  to  a  larger  research  paradigm  to  assess  the  impact  of  network  parameters  on  task  performance 
in  a  flight  simulation  environment. 

Methods:  Five  observers  were  used  to  assess  the  effects  of  distance  from  eyepoint  and  position 
smoothing  on  the  detection  threshold  of  positional  displacements,  or  jitter  caused  by  network  transport 
delay.  The  design  of  this  experiment  included  two  levels  of  position  smoothing  (no  smoothing  and  1  sec 
of  smoothing),  three  simulated  distances  (100,  200,  and  400  meters)  and  thirteen  displacement  amplitudes 
(between  0  and  8.192  meters)  for  each  distance.  We  used  a  repeated  measures  design  for  a  total  of  2 
(smoothing)  x  3  (distances)  x  13  (displacement  amplitudes)  x  5  (observers)  xl5  (repetitions). 

Stimuli  consisted  of  a  blue  sky  and  a  fully  textured,  realistic  three-dimensional  model  of  an  F-16.  Visual 
scenes  were  rendered  with  MetaVR’s  real  time  visualization  application,  Virtual  Reality  Scene  Generator 
(VRSG)  ™  [20].  Custom  software,  written  in  C++,  was  used  to  control  the  characteristics,  timing,  and 
sequencing  of  the  motion  sequences,  to  communicate  with  VRSG,  and  to  record  the  observer’s  responses. 

A  trial  consisted  of  one,  2-second  presentation  of  the  F-16  on  a  stationary  visual  scene.  The  blue-sky 
background  was  present  continuously  throughout  each  block  of  trials.  Simulated  distances  were  varied 
across  blocks  of  trials.  For  each  block  of  distance  trials  there  were  a  range  of  13  different  displacement 
amplitudes.  Following  each  presentation  of  the  aircraft  text  was  presented  on  the  screen  to  ask  observers 
“Did  you  detect  jitter?”  and  to  cue  responses  of  “Yes”  or  “No.” 

Results:  The  results  were  analyzed  by  fitting  a  Weibull  curve  to  the  mean  response  data  from  each 
observer  for  each  combination  of  smoothing  and  distance  to  obtain  a  threshold  at  the  63%  level  of 
performance.  The  data  was  then  converted  to  visual  angle  in  arcmin  to  assess  whether  observers  required 
different  visual  information  for  each  combination  of  conditions.  Both  the  raw  distance  and  the  visual 
angle  data  were  then  subjected  to  a  repeated  measures  analysis  of  variance  (ANOVA)  to  assess  the 
presence  of  any  main  effects  or  interactions  between  distance  and  position  smoothing.  Finally,  t-tests 
were  computed  to  determine  if  there  was  a  difference  in  detection  threshold  between  the  no  smoothing 
and  position  smoothing  conditions  for  both  the  raw  distance  and  visual  angle  data. 

Figure  1  shows  detection  thresholds  in  meters  for  the  two  smoothing  conditions  across  the  three  distance 
conditions.  The  figure  shows  that  for  both  smoothing  conditions,  detection  threshold  generally  increased 
as  a  function  of  distance.  The  figure  also  shows  that  the  addition  of  smoothing  also  increased  detection 
thresholds.  An  ANOVA  revealed  that  the  effect  of  simulated  distance  was  statistically  significant  F  (2,  8) 
=  6.97,  p  <  0.05.  A  post-hoc  pairwise  comparison  showed  that  the  following  simulated  distances  were 
significantly  different  (p  <  0.05):  100  m  versus  200  m  and  100  m  versus  400  m. 
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Figure  10.  Mean  threshold  amplitudes  in  meters  for  three  simulated  distances  and  two  smoothing 
conditions.  The  circle  represents  the  no  smoothing  enabled  condition  and  the  square  represents  the  1  s 
smoothing  condition.  Error  bars  represent  the  actual  computed  standard  error  of  the  mean. 

We  did  not  find  a  significant  overall  effect  of  smoothing,  or  an  interaction  with  distance  from  eyepoint. 
Figure  2  shows  the  proportion  of  correct  responses  out  of  fifteen  trials  for  the  two  smoothing  conditions 
averaged  across  all  subjects  and  simulated  distances.  Since  there  is  a  visual  difference  in  overall 
detection  threshold  between  the  two  smoothing  conditions,  we  also  wanted  to  test  the  null  hypothesis  that 
there  would  not  be  a  difference  between  the  no  smoothing  and  1  s  smoothing  thresholds  using  an  a  priori 
contrast.  We  found,  using  a  two  tailed  t-test,  a  significant  difference  in  detection  threshold  between  the 
no  smoothing  and  smoothing  conditions,  t  (13)  =  -2.26,  p  <0.04. 


Amplitude  (Meters) 


Figure  11.  Percentage  of  correct  responses  out  of fifteen  trials  for  the  two  smoothing  conditions 
averaged  across  all  subjects  and  simulated  distances  (each  point  represents  225  data  points).  The  black 
circle  represents  the  no  smoothing  condition  and  the  white  circle  represents  the  1  s  smoothing  condition. 
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To  assess  the  effect  of  distance  and  position  smoothing  on  the  visual  angle  of  the  detection  threshold,  we 
ran  a  Repeated  Measures  ANOVA.  There  were  no  significant  effects  or  interactions  for  either  distance  or 
smoothing.  Figure  3  shows  the  detection  thresholds  in  arcmin  for  the  two  smoothing  conditions  across 
the  three  distance  conditions.  The  figure  shows  that  an  increase  in  visual  angle  of  the  displacement 
amplitude  was  not  required  for  detection  as  the  simulated  distance  was  increased.  However,  it  is  shown 
that  the  addition  of  smoothing  did  increase  the  visual  angle  of  the  detection  threshold.  We  found,  using  a 
two  tailed  t-test,  a  significant  difference  in  the  visual  angle  of  the  detection  threshold  between  the  no 
smoothing  and  smoothing  conditions,  t  (13)  =  2.16,  p  <0.01. 


Figure  12.  Mean  threshold  amplitudes  in  arcmin  for  three  simulated  distances  and  two  smoothing 
conditions.  Circles  represent  no  smoothing  enabled  condition  and  squares  represent  the  1  s  smoothing 
condition.  Error  bars  represent  the  actual  standard  error  of  the  mean. 

Discussion:  The  results  of  this  experiment  show  that  increasing  simulated  distance  increases  the  amount 
of  displacement,  in  simulation  space,  required  to  detect  target  aircraft  motion.  However,  when  the 
displacement  was  expressed  in  units  of  visual  angle,  the  effect  of  simulated  distance  was  not  significant, 
indicating  that  the  thresholds  were  determined  by  angular  displacement.  Additionally,  under  the 
conditions  used  in  this  study,  smoothing  approximately  doubled  angular  displacement  thresholds. 

Under  all  conditions,  displacement  thresholds  were  small  -  approximately  2  arcmin  for  the  unsmoothed 
condition  and  4  arcmin  for  the  smoothed  condition.  This  translates  into  displacement  thresholds 
of  V2  pixel  and  1  pixel  for  the  unsmoothed  and  smoothed  conditions,  respectively.  In  fact,  studies 
performed  under  optimal  conditions  report  displacement  thresholds  of  2  arcsec  [21]. 

The  finding  that  smoothing,  which  decreases  target  velocity,  increased  the  displacement  threshold  is  not 
surprising.  Smoothing  is  used  in  a  networked  environment  to  reduce  the  visual  saliency  of  the 
displacement  and  provide  a  more  realistic  looking  flight  path  to  an  observer.  However,  the  smoothed 
flight  path  will  provide  a  less  accurate  representation  of  the  true  flight  path  [19].  The  high  sensitivity  of 
the  visual  system  in  detecting  displacement  shown  in  this  study  and  others  suggests  that  the  positional 
error  of  the  smoothed  flight  path  can  be  encoded  by  the  visual  system  and  could,  therefore  result  in 
performance  degradation.  Furthermore,  because  the  smoothed  flight  path  looks  realistic  it  may  alter  a 
pilot’s  performance  whereas  the  unrealistic  jump  with  smoothing  disabled  can  be  easily 
discounted  by  the  pilot.  Therefore  the  benefits  and  advantages  of  smoothing  are  still  subject  to  debate  and 
to  future  research. 
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As  stated  previously,  this  experiment  is  the  first  in  a  series  of  experiments  designed  to  determine  the 
effect  of  network  conditions  on  flight  tasks  in  a  networked  simulator  training  environment.  At  the  Air 
Force  Research  Laboratory  in  Mesa,  AZ  we  are  conducting  a  detailed  evaluation  of  the  actual  physical 
positional  discrepancies  that  occur  as  a  function  of  the  overall  load  of  the  network.  This  evaluation  will 
allow  us  to  compare  our  results  from  the  present  experiment  to  actual  positional  discrepancies  that  would 
manifest  as  a  result  of  network  load.  We  are  also  conducting  another  evaluation  to  assess  the  different 
types  of  positional  discrepancies  induced  by  network  packet  load  over  a  long-distance  network  (i.e.  from 
Mesa,  AZ  to  Melbourne,  Australia). 
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Introduction:  Digital  projectors  based  on  liquid  crystal  or  micro-mirror  technologies  provide  higher 
spatial  resolution  than  the  CRTs  typically  used  in  flight-simulator  applications.  However,  their  temporal 
response  is  limited  by  long  hold-times.  Hold-time  is  the  interval  that  pixels  are  activated  during  each 
frame,  and  it  is  related  to  both  the  design  of  the  driver  circuitry  and  the  display  itself.  Long  hold-times 
result  in  the  blurring  of  moving  imagery,  which  can  affect  the  detection  and  identification  of  simulated 
targets  as  well  as  the  perceived  realism  of  simulated  scenes. 

Described  here  are  the  results  of  an  evaluation  of  several  digital  projectors  that  implement  various 
techniques  for  reducing  pixel  hold-time.  The  evaluation  included  estimates  of  both  spatial  and  temporal 
resolution,  as  well  as  perceptual  tests  used  to  assess  the  validity  of  those  estimates.  The  techniques 
described  here  can  be  used  to  assess  the  potential  utility  of  candidate  projectors  for  a  given  simulator 
application. 

Methods:  The  following  projectors  were  tested:  ferro-electric  liquid  crystal  on  silicon  (FLCoS),  liquid 
crystal  on  silicon  (LCoS),  liquid  crystal  (LCD),  digital  light  projector  (DLP,  a  digital  micro-mirror 
device,  or  DMD),  and  cathode  ray  tube  (CRT).  The  hold-time  of  the  FLCoS  and  LCD  projectors  was 
varied  using  mechanical  shutters,  and  the  hold-time  of  the  DLP  projector  was  varied  using  an 
electronic  shutter.  The  CRT  and  LCD  projectors  were  used  mainly  for  comparison  and  so  their  hold- 
times  were  not  varied. 

The  brightness,  contrast,  and  gamma  function  of  each  display  were  first  determined  in  preparation  for  the 
spatial  resolution,  temporal  response,  and  the  two  temporal-resolution  measurements.  The  brightness  and 
contrast  of  the  CRT  were  adjusted  so  as  to  obtain  the  brightest  image  consistent  with  no  saturation  of  the 
display  gamma  function  (i.e.,  the  function  relating  luminance  to  input  graylevel).  Overall  luminance  and 
contrast  were  then  measured  using  the  central  four  squares  of  a  4  x  4  checkerboard  test  pattern  that 
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covered  the  entire  image.  The  optimum  luminance  level  determined  for  the  CRT  was  also  used  for  the 
other  displays. 

Spatial  resolution  was  measured  using  a  standard  procedure  that  involved  displaying  grille  patterns 
consisting  of  either  horizontal  or  vertical  lines  in  one  of  three  line  widths  (1-on/l-off,  2-on/2-off,  and  3- 
on/3-off).  The  luminance  distribution  of  the  patterns  was  then  measured  in  the  direction  orthogonal  to  the 
lines,  and  the  contrast  of  the  patterns  was  calculated.  Contrast  was  then  plotted  as  a  function  of  grille- 
pattern  frequency,  and  interpolation  was  used  to  determine  the  effective  number  of  lines  corresponding  to 
a  contrast  of  25%,  which  when  converted  to  distance  on  the  on  the  screen  is  a  measure  of  spatial 
resolution.  The  number  of  resolved  lines  was  then  obtained  by  dividing  the  pixel  count  of  the  projector 
by  the  effective  number  of  lines. Display  temporal  response  was  measured  by  using  a  photodiode  to 
measure  the  temporal  light  distribution  associated  with  a  small  test  square  flickering  at  30  Hz.  Perceptual 
assessments  of  display  temporal  resolution  were  performed  using  two  techniques.  The  first  technique  was 
a  moving-line  blur  test  in  which  a  pair  of  vertical,  white  lines,  each  one  pixel  wide,  was  moved 
horizontally  across  a  dark  field  at  various  speeds.  Observers  adjusted  the  width  of  the  gap  between  the 
test  lines  such  that  the  size  of  the  gap  was  minimized.  The  rationale  of  this  test  is  that  a  higher  temporal 
resolution  will  result  in  less  blurring  of  the  vertical  test  lines  in  the  direction  of  motion,  and  this  in  turn 
will  allow  the  observers  to  see  the  gap  with  smaller  separations  between  the  vertical  lines.  Thus,  adjusted 
gap  width  may  be  taken  as  a  measure  of  image  blur.  The  second  technique  was  an  aircraft  roll-detection 
task.  This  task  is  conceptually  similar  to  the  moving-line  test,  but  provides  a  motion-blur  estimate  for  a 
more  realistic  flight-simulator  task.  In  this  task,  jet-aircraft  models  were  moved  laterally  across  the 
display,  and  at  the  half-way  point  the  aircraft  rolled  either  0  degrees  (on  half  of  the  trials)  or 
between  4  and  23  degrees  (on  the  other  half  of  the  trials).  Roll-detection  thresholds  were  obtained  by 
finding  the  degree  of  roll  corresponding  to  82%-correct  roll  detections. 

Results:  The  number  of  resolved  lines  for  the  projectors  tested  ranged  from  about  1200  lines  for  the  CRT 
projector  to  about  4000  lines  for  the  DLP  and  LCoS  projectors.  Projector  hold-times  ranged  from  less 
than  one  millisecond  for  the  CRT  to  about  16.7  milliseconds  (i.e.,  the  full  video  frame)  for  the  LCD. 

For  the  CRT  projector,  perceived  blur,  as  measured  using  the  moving-line  test,  increased  from  about  5  to 
12  arcminutes  as  target  speed  increased  from  about  5  to  68  degrees/second.  For  the  LCD,  LCoS,  and 
DLP  projectors  tested  with  hold-times  of  over  10  milliseconds,  perceived  blur  increased 
from  5-10  arcminutes  for  target  speeds  below  10  degrees/second  to  40-60  arcminutes  for  target  speeds 
greater  than  about  50  degrees/second.  As  hold-time  was  decreased  for  the  LCoS  and  DLP  projectors, 
perceived  blur  also  decreased,  although  the  decrease  was  generally  proportional  to  target  speed.  For  the 
LCoS  and  DLP  projectors,  perceived  blur  was  not  significantly  different  from  that  of  a  CRT  when  hold¬ 
time  was  reduced  to  about  four  to  six  milliseconds.  The  threshold  roll-detection  magnitudes  were 
about  10,  14,  and  16  degrees  for  aircraft-target  speeds  of  8,  17.5,  and  35  degree/sec,  respectively.  These 
data  indicate  a  clear  correlation  between  the  roll-detection  data  and  both  the  temporal-response 
measurements  and  the  the  moving-line  test  data. 

Implications:  The  U.S.  Air  Force  and  Navy  are  considering,  or  are  in  the  process  of,  replacing  CRT 
displays  with  digital  displays  for  use  in  flight  simulators.  However,  low  temporal  resolution  and 
concomitant  moving-image  blur  is  a  significant  problem  for  the  use  of  these  digital  displays.  The  display 
evaluation  techniques  developed  at  AFRL,  Mesa  provide  a  relatively  simple  way  to  objectively  measure 
both  display  spatial  and  temporal  resolution,  and  additionally,  to  predict  their  perceptual  consequences. 
The  results  of  these  evaluations  show  that,  for  all  projector  types  tested,  reducing  hold-time  to  about  four 
to  six  milliseconds  effectively  reduced  moving-image  blur  to  that  of  a  CRT  projector,  which  is  currently 
the  accepted  standard  for  projector  temporal  response.  Finally,  the  results  of  the  temporal-resolution 
measurements  were  found  to  correlate  with  performance  on  an  air-to-air  task  that  is  representative  of 
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those  performed  in  full-field  flight  simulators.  In  order  to  assess  projectors  in  applied  settings,  analogous 
tasks  will  need  to  be  devised  and  implemented  for  the  flight  simulators  of  interest. 
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Although  Night  Vision  Goggles  (NVGs)  support  and  enhance  visual  perception  in  low-light  or  dark 
conditions  the  optical  and  electro-optical  characteristics  of  NVGs  impact  visual  perception  differently 
than  normal  light  conditions.  Consequently,  most  published  studies  investigating  the  impact  of  NVG  use 
on  human  performance  have  been  based  on  psychophysical  and  perception  research  approaches  (e.g., 
Macuda,  et  ah,  2004;  Niall  et  ah,  1999)  However,  anecdotal  reports  have  suggested  that  NVGs  affect 
spatial  orientation  and  way-finding,  implying  that  NVG  use  also  influences  human  cognitive 
functions.  Few  studies  have  systematically  characterized  the  cognitive  nature  of  using  NVGs,  particularly 
on  spatial  behavior. 

This  paper  aims  to  present  an  empirical  methodology  to  study  NVG  use  on  way-finding  and  orientation 
performance,  by  introducing  a  spatial  cognition  research  paradigm.  The  paradigm  is  a  between  subjects 
design  composed  of  two  main  phases:  1)  a  learning  and  practice  phase;  and  2)  tests  of  acquired  spatial 
knowledge.  In  the  learning  and  practice  phase,  participants  learn  the  environment  through  active 
navigation  and  way-finding,  searching  for  targets  within  a  life-sized  maze  with  or  without  NVGs.  In  the 
second  phase,  knowledge  of  the  environment  is  tested  with  two  spatial  memory  tests  (a  judgment  of 
relative  direction  and  map  drawing  task).  It  is  proposed  that  such  an  approach  can  be  used  to  study  both 
the  perceptual  and  cognitive  aspects  of  using  head  mounted  vision  enhancing  devices,  particularly  for 
search  and  way-finding  tasks.  Furthermore,  this  approach  can  be  utilized  in  the  comparative  and 
acceptance  testing  of  new  vision  enhancing  technologies.  The  methodology  used  in  this  study  can  also  be 
utilized  in  developing  and  assessing  training  guidelines  and  strategies  that  are  more  compatible 
with  humans’  spatial  cognition  processes.  Some  practical  implications  regarding  NVG  training  and 
possible  field  research  to  explore  improvements  in  the  design  and  deployment  of  vision-enhancing 
devices  are  also  discussed. 

In  the  current  study,  findings  show  that  participants  using  NVGs  while  navigating  and  way-finding  had 
longer  navigation  times  and  more  excess  turns  compared  to  those  not  using  NVGs.  Moreover,  a 
significant  decrease  in  navigation  times  and  navigational  steps  compared  to  controls.  In  the  judgement  of 
relative  direction  task,  relative  direction  pointing  to  searched  objects  across  rooms  and  to  distractors  in  the 
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same  room  was  more  accurate  for  those  who  performed  the  search  without  NVGs.  In  the  map  drawing 
task,  participants  using  NVGs  were  more  likely  to  position  more  objects  incorrectly  and  receive  worst 
map  goodness  scores. 

The  results  demonstrate  that  NVGs  affect  spatial  navigation  and  way-finding  performance  and  the 
acquisition  of  spatial  knowledge.  By  objectively  characterizing  the  impact  of  NVGs  on  spatial  way¬ 
finding  and  orientation,  the  current  results  provide  empirical  evidence  beyond  that  of  anecdotal  reports. 
The  findings  empirically  demonstrate  the  effectiveness  of  the  research  paradigm. 
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Overview  and  Purpose:  In  modern  Night  Vision  Devices  (NVDs)  ‘halo’  around  bright  light  sources 
remains  a  salient  imaging  artifact.  Although  a  common  feature  of  image  intensified  imagery,  little  is 
known  of  the  perceptual  and  operational  effects  of  this  device  limitation.  This  paper  describes  two  related 
sets  of  experiments.  In  the  first  set  of  experiments,  we  provide  quantitative  measurements  of  Night  Vision 
Device  (NVD)  halos  formed  by  light  sources  as  a  function  of  intensity  and  distance.  This  characterization 
allows  for  analysis  of  the  possible  effects  of  halo  on  human  perception  through  NVDs.  In  the  second  set 
of  experiments,  the  effects  of  halation  on  the  perception  of  depth  and  environmental  layout  are 
investigated  psychophysically.  The  custom  simulation  environment  used  and  results  from  psychophysical 
experiments  designed  to  analyze  halo-induced  errors  in  slope  estimation  are  presented. 

Background:  Accurate  simulation  of  image  intensifier  physics  and  NVD  scene  modeling  is  challenging 
and  computationally  demanding,  yet  needs  to  be  performed  in  real-time  at  high  frame  rates  and  at  high- 
resolution  in  advanced  military  simulators.  Given  the  constraints  of  the  real-time  simulation,  it  is 
important  to  understand  how  NVD  artifacts  impact  task  performance  in  order  to  make  rational 
engineering  decisions  about  the  required  level  of  fidelity  of  the  NVD  simulation.  A  salient  artifact  of 
NVD  viewing  is  halo,  the  phenomenon  where  the  image  of  a  bright  light  source  appears  surrounded  by 
disc-like  halo.  High-fidelity  physical  modeling  of  these  halo  phenomena  would  be  computationally 
expensive.  To  evaluate  the  level  of  approximation  that  would  be  sufficient  for  training  purposes  human 
factors  data  is  required. 

Experiment  Series  1,  Halo  Metrics:  A  custom  built  light  source  and  optical  bench  were  designed  to 
present  variable  intensity  NVD  stimuli  at  a  range  of  distances.  For  each  condition,  three  measurements  of 
halo  angular  size  were  obtained.  Two  subjective  measures  were  used  to  estimate  apparent  halo  angular 
size.  A  digital  camera  and  image  processing  algorithms  were  used  to  obtain  estimates  of  the  objective 
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(physical)  angular  size  of  the  halo  image  displayed  on  the  NVD  phosphor  screen.  All  measures  were  cross 
calibrated  to  each  other,  and  to  standard  targets  at  known  distances  to  get  commensurable  data  in  terms  of 
visual  angle  at  the  NVD. 

The  results  suggest  that  that  if  a  point  source  is  bright  enough  to  generate  a  halo,  then  the  size  (but  not 
intensity  or  transparency)  of  that  halo  is  approximately  constant  with  respect  to  distance  and  intensity,  at 
least  until  secondary  halos  are  apparent.  Any  change  in  apparent  size  is  small  compared  to  the  more 
salient  effects  of  halo  disappearance  or  double  halo  appearance  as  the  source  intensity  is  decreased  or 
increased  respectively. 

Experiment  Series  2,  Psychophysical  Experiments  Simulating  Helicopter  Approach:  The  finding  that 
primary  halos  do  not  change  appreciably  in  angular  size  with  changes  in  distance  to  the  generating  source 
lends  them  interesting  properties  as  perceptual  stimuli.  Specifically,  halos  of  light  sources  in  the  scene 
appear  to  be  associated  with  the  generating  light  sources  and  localized  in  the  scene  but  do  not  undergo  the 
same  perspective  transformation  as  other  stimuli  encountered  in  our  normal  visual  experience.  Thus,  we 
might  expect  that  halos  might  be  subject  to  a  variety  of  perspective-based  illusions.  For  instance,  a  halo 
should  appear  to  shrink  as  a  light  source  is  approached,  and  an  isolated  bright  halo  should  appear  nearer 
than  a  dim  one  even  if  further  away.  These  predictions  of  the  visual  perception  of  isolated  halos  have 
been  verified  informally  in  our  lab.  With  a  mobile  observer  navigating  through  a  complex  environment, 
the  effects  of  halos  on  perception  are  more  difficult  to  predict.  In  the  present  experiments  we  examine 
how  halos  may  act  as  visual  stimuli  to  influence  the  perception  of  objects  and  scene  layout  in  more 
complicated  visual  scenes.  To  simulate  these  environments  under  controlled  laboratory  conditions  a 
custom  NVD  simulation  environment  was  developed. 

Simulation  Environment:  Based  on  physical  models  of  NVD  operation,  three-dimensional  computer 
graphic  simulations  over  modeled  terrain  were  rendered  by  a  cluster  of  PC  workstations.  Scenes  were 
modeled  in  3D  Studio  Max  based  on  digital  terrain  maps.  An  in-house  developed  virtual  environment 
application  programming  interface  (VE  2.2)  was  used  to  control  and  configure  the  simulation,  display, 
and  input  devices.  The  simulation  is  primarily  visual  and  aircraft  dynamics  were  not  modeled.  Extensive 
use  of  state-of-the  art  shader  language  techniques  allowed  real-time  generation  of  the  modeled  NVD  halo. 
The  experiments  were  conducted  in  a  large  format  stereoscopic  virtual  immersive  environment. 

Procedure:  In  one  set  of  experiments,  observers  (N=5)  were  required  to  judge  their  attitude  with  respect 
to  the  ground  during  simulated  flight  over  terrain.  The  modeled  world  contained  a  large  flat  plateau  with  a 
landing  strip  in  the  centre.  The  plateau  was  surrounded  by  simulated  mountains  that  were  unpredictable  in 
location,  height  and  distance  on  the  plateau  to  prevent  their  being  used  as  visual  cues.  The  surfaces  were 
rendered  with  halo  or  non-halo  inducing  light  sources  distributed  on  the  ground  plane.  The  intrinsic 
texture  and  perspective  cues  to  depth  in  the  scenes  were  varied  by  changing  the  regularity  and 
configuration  of  the  light  sources.  To  explore  the  effects  of  observer  motion  the  simulation  was  either 
static  (simulating  a  hover),  or  depicted  lateral  motion  or  a  simulated  level  flight  approach.  During  the 
simulation,  observers  were  instructed  to  estimate  the  slope  of  the  ground  (in  pitch)  with  respect  to  the 
virtual  camera.  Following  the  test  stimulus,  a  full-cue  daylight  scene  was  displayed  with  random  pitch 
angle.  The  observers  were  given  control  of  the  pitch  of  the  virtual  camera,  and  were  asked  to  match  the 
attitude  of  the  virtual  camera  to  their  estimate. 

In  another  set  of  experiments,  the  same  observers  viewed  a  simulated  approach  to  the  runway,  and 
estimated  the  aim-point  or  touchdown  point  given  their  current  heading.  After  viewing  the  approach 
sequence,  the  simulated  approach  stopped  and  the  observers  moved  a  visual  marker  to  align  with  the 
estimated  touchdown  point. 
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Results:  Observers  perceived  increasing  slant  with  increasing  simulated  slant  in  the  daylight  conditions 
and  in  night  time  conditions  with  regular  patterns  of  lights.  Irregular  patterns  of  lights  conditions  resulted 
in  a  weak  correlation  between  perceived  and  simulated  slant.  When  slant  is  perceived  and  halos  are 
present,  subjects  report  a  strong  impression  of  an  increase  in  the  perceived  size  of  the  halos  with 
simulated  distance  although  halos  are  constant  size  over  the  image.  This  is  appropriate  size  constancy  as 
found  in  Emmert’s  law.  There  is  little  conflict  here  as  the  strong  slant  cues  dominate  and  the  halo 
invariance  is  seen  as  a  size  gradient.  Subjects  report  that  they  can  ‘see  through’  the  halo  to  the  slanted 
surface  suggesting  they  can  segregate  the  slant  of  the  surface  from  the  frontal  slant  specified  by  the  halo. 
This  subjective  report  is  consistent  with  the  finding  that  subjects  are  able  to  estimate  surface  slant  in  the 
presence  of  halo  as  accurately  as  in  halo-free  scenes. 

Conclusions:  NVD  halos  generated  by  light  sources  in  a  scene  have  a  size  that  is  approximately  invariant 
with  intensity  and  distance.  Objective  and  subjective  measures  of  halo  geometry  indicate  that  halo  size, 
when  halo  is  present,  is  relatively  invariant  of  target  distance  or  intensity.  This  property  results  in 
perceptual  distortions  and  strong  illusions  with  isolated  stimuli.  In  complex  scenes,  systematic  distortions 
of  slant  are  predicted  due  to  an  imposed  texture  gradient  created  by  the  halo.  We  investigated  this 
hypothesis  in  psychophysical  experiments.  The  results  suggest  that  perception  of  slant  and  glideslope  in 
complex  scenes  is  remarkably  tolerant  of  texture  gradients  imposed  by  NVG  halo.  These  results 
will  be  discussed  in  terms  of  NVG  simulation  and  of  the  ability  of  human  operators  to  compensate  for 
perceptual  distortions. 
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Abstract:  One  hundred  and  four  inexperienced  observers  were  trained  on  a  PC-based  flight  control  task 
in  order  to  measure  the  effect  of  two  flight  simulation  variables;  screen  resolution  and  training  speed,  on 
post-training  performance.  A  throttle  and  joystick  controlled  the  speed,  radius  and  inclination  angle  of  an 
orbiting  F-18  chase  aircraft.  The  control  task  was  to  overtake  and  intercept  a  target  F-18  flying  on  another 
orbit  with  a  different  radius  and  inclination.  The  simulation  included  a  realistic  F-18  cockpit  for  the  chase 
plane,  a  realistic  F-18  target  aircraft,  textured  terrain,  a  horizon,  clouds  and  sun.  The  variables  of  interest 
were  screen  resolution  (768  x  1024,  960  x  1280,  1200  x  1600  [criterion])  and  simulated  training  speeds  of 
450,  900  (criterion)  or  1350  knots.  Experiment  one  was  carried  out  in  a  single  session  at  criterion 
resolution  with  50  observers.  It  included  a  pretest  at  criterion  speed  and  a  training  session  that  presented 
either  18  training  trials  at  900  knots,  eighteen  at  1350  knots,  nine  trials  at  450  and  nine  at  900  knots,  or 
six  trials  at  each  of  450,  900  and  1350  knots  to  different  groups  of  observers.  Consistent  fast  (1350  knots) 
training  generated  the  largest  training  errors  but  the  best  post-training  (criterion  speed)  performance. 
Experiment  two,  with  fifty-four  observers,  used  the  same  task.  The  three  screen  resolutions  were  varied 
between  observers  while  training  speeds  were  varied  within  observers  on  three  sessions  over  three  days. 
Familiarization  and  the  criterion  pretest  were  completed  on  day  one.  A  single  training  session  and 
criterion  posttest  were  completed  on  each  of  days  two  and  three.  All  permutations  of  pairs  of  450,  900  and 
1350  knot  speeds  were  used  during  the  training  sessions  over  days  two  and  three.  Following  the  first 
training  session,  1350-knot  training  at  high  (criterion)  resolution  and  medium  resolution  produced  the 
best  post-training  performance  results.  Following  both  training  sessions,  the  best  post-training  results 
occurred  following  high  resolution  training  at  the  fast  (1350  knot)  training  speed  in  both  training  sessions. 
Performance  under  low-resolution  conditions  was  significantly  worse  than  under  high  (criterion)  or 
medium-resolution  training.  These  results  re-emphasize  the  importance  of  screen  resolution  during 
simulator  training,  and  they  support  earlier  findings  that  greater-than-realistic  speed  training  improves 
performance  on  a  simulated  flight  control  task  carried  out  at  a  realistic  (criterion)  posttest  speed. 


3  This  work  was  completed  under  a  contract  between  Human  Factors  North  Inc  and  Defence  Research  and 
Development  Canada  (DRDC).  We  thank  Josie  Caro  for  carrying  out  indispensable  pilot  studies  that  facilitated  the 
work  reported  here.  Software  for  this  simulation  was  developed  by  Array  Systems  Computing  Inc.  under  contract  to 
DRDC. 
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Introduction:  This  work  is  concerned  with  registration  of  data  in  geospatial  databases,  especially  with 
registering  images  taken  by  different  sensors  and  from  different  viewpoints  of  the  same  scene.  This 
research  has  many  applications  in  creating  and  updating  maps,  surveys  and  other  geospatial  data  sources. 
While  considerable  work  has  been  performed  in  image  registration  [22],  extant  approaches  break  down  as 
viewpoint  and/or  sensor  vary  beyond  relatively  small  changes.  Further,  extant  image-based  registration 
technology  has  only  been  demonstrated  to  support  video-to-reference  image  alignment  when  initialized  to 
within  several  hundred  pixels  of  the  correct  result  [23].  Due  to  errors,  drop  outs  and  otherwise  limited 
availability  of  telemetry,  ineffective  a  priori  knowledge  of  relative  video/reference  image  alignment  is  a 
real-world  problem. 

The  developed  approach  allows  video-based  image  descriptors  to  index  directly  into  a  reference  image 
database.  Successful  indexing  into  the  database  implies  that  approximate  position  of  the  video  relative  to 
the  reference  has  been  recovered;  this  information  can  then  serve  to  initialize  extant  technology  for  video- 
to-reference  registration.  The  approach  provides  uniform  representation  of  video  and  reference  imagery 
and  a  corresponding  method  for  quantifying  the  goodness  of  match  between  two  image  samples.  The 
representation  combines  image  appearance,  characterized  in  terms  of  texture  defined  regions,  and  image 
geometry,  characterized  in  terms  of  spatial  relationships  between  textured  regions.  By  construction,  the 
matching  method  is  robust  to  a  range  of  photometric  and  geometric  distortions  between  image  sources, 
including  changes  in  grey-level  contrast  and  affine  geometric  transformations.  The  developed  approach 
has  been  algorithmically  specified  and  instantiated  in  software.  Empirical  evaluations  with  a  reference 
image  database  derived  from  orthoimages  of  distinct  geographic  locations  that  is  indexed  via  synthetic 
aerial  video  document  the  promise  of  the  approach. 

Technical  approach:  The  approach  to  indexing  video  to  reference  imagery  involves  a  novel  integration 
of  regional  appearance  descriptors  and  geometric  relationships  between  regions.  Previous  image  indexing 
research  has  tended  to  concentrate  on  only  appearance  or  only  geometry  [24].  The  philosophy  of  the 
proposed  approach  is  that  the  combination  of  these  two  sources  of  information  will  yield  a  more 
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discriminative  approach  than  either  one  alone.  Image  appearance  is  characterized  in  terms  of  texture 
descriptors.  Texture  is  employed  as  it  is  manifest  in  any  imagery  source  (e.g.,  unlike  colour,  which 
depends  on  capture  of  multiple  spectral  bands).  Geometric  relationships  are  captured  in  terms  of  an  affine 
invariant,  which  provides  robustness  to  the  range  of  variation  that  is  anticipated  in  matching  imagery  of 
concern,  i.e.,  aerial  video  to  orthophoto  reference  imagery. 

Appearance:  When  observed  through  the  field  of  view  of  any  single  image  in  a  video  sequence, 
appearance  can  be  ambiguous  due  to  lack  of  context.  For  example,  a  single  frame  that  is  completely  filled 
by  uniform  forest  canopy  would  be  hard  to  discern  from  another  such  frame. 

The  proposed  solution  to  this  challenge  is  to  consider  not  individual  video  frames  in  isolation,  but  rather 
to  mosaic  collections  of  frames  across  a  video  into  a  single  larger  format  image  and  use  the  mosaiced 
image  as  the  basis  for  subsequent  indexing  to  reference.  In  the  current  system,  a  commercially  available 
image  mosaicing  software  tool  is  used  to  perform  the  necessary  processing  [25]. 

For  texture -based  appearance  descriptors,  standard  methods  in  computer  vision  are  followed  to  capture 
image  structure  in  terms  of  statistics  of  energy  across  multiple  scales  and  orientations.  In  particular,  given 
a  region  of  interest,  the  image  data  is  filtered  with  a  set  of  quadrature -pair  bandpass  filters,  tuned  for 
multiple  scales  and  orientations.  The  derived  images  are  pointwise  rectified  and  combined  in  quadrature. 
Finally,  each  image  is  pointwise  normalized  through  division  by  the  sum  of  all  rectified  image  values  at 
the  same  point.  This  normalization  procedure  provides  for  invariance  to  local  image  contrast,  as  local 
energy  in  each  band  is  given  as  a  percentage  of  total  energy  across  all  bands.  The  result  yields  a  set  of 
normalized  energy  images  that  parse  the  original  image  data  according  to  scale  and  orientation  with 
robustness  to  particulars  of  local  image  photometry.  In  the  current  implementation,  4  orientations  and  4 
scales  are  used  in  filtering. 

The  derived  energy  images  capture  local  image  appearance,  i.e.,  they  provide  pointwise  characterization. 
As  texture  is  a  regional  property  of  an  image,  the  pointwise  measurements  are  clustered  to  provide  a 
spatial  segmentation  of  the  imagery  into  regions  of  uniform  texture.  To  perform  the  clustering,  a 
modification  of  an  extant  approach  is  employed  [26].  This  approach  is  based  on  clustering  regions  so  that 
within  cluster  variation  is  small  relative  to  between  cluster  variation.  While  the  original  method  made  use 
of  simple  grey-level  images  and  intensity  differences  to  calculate  variation,  the  current  approach  makes 
use  of  the  derived  energy  images  and  the  inner  product  to  calculate  variation.  These  modifications  are 
motivated  by  the  present  concern  with  texture-based  appearance  descriptors. 

Given  the  recovered  region  segmentation,  the  energy  image  information  is  accumulated  across  each 
region  by  computing  the  mean  response  within  each  band.  This  yields  a  16  dimensional  vector  (4  scales  x 
4  orientations)  that  serves  to  represent  the  appearance  of  the  region.  This  same  representation  is  used  to 
characterize  image  appearance  of  regions  in  a  video  of  interest  as  well  as  reference  orthoimages. 

As  defined  so  far,  the  appearance  representation  is  sensitive  to  rotation.  Oriented  texture  appears 
differently  under  in  plane  rotations.  Robustness  to  rotation  between  the  probes  and  the  database  entries  is 
important  as  it  corresponds  to  view  changes  between  the  sensor  platforms.  The  solution  to  this  challenge 
lies  in  the  fact  that  rotation  space  is  cyclic,  e.g.,  rotating  the  image  by  360  makes  no  change.  This  fact  is 
exploited  to  make  representation  robust  to  rotation  by  aligning  two  representations  in  rotation  space.  In 
particular,  for  two  texture  vectors  to  be  compared,  one  is  systematically  rotated  with  respect  to  the  other 
and  for  each  relative  orientation  the  inner  product  is  calculated.  The  rotation  that  achieves  the  largest 
inner  product  is  taken  as  the  aligning  transformation. 

Another  important  challenge  arises  with  respect  to  scale  invariance.  Multiscale  texture  appears  different 
under  variable  spatial  resolution.  The  employed  approach  to  scale  invariance  is  similar  to  the  approach  to 
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rotation  invariance,  except  for  the  fact  that  scale  is  not  cyclic,  i.e.,  systematic  scale  change  never  returns 
to  the  starting  scale.  Still,  an  approach  can  be  realized  based  on  consideration  of  matches  that  are  shifted 
in  scale.  In  particular,  given  two  texture  vectors  to  be  compared,  one  is  systematically  shifted  with  respect 
to  the  other  in  scale  and  the  inner  product  is  calculated.  The  shift  that  achieves  the  largest  inner  product  is 
taken  as  the  aligning  transformation. 

Geometry:  To  capture  geometric  relationships  between  image  texture  patches,  an  affine  invariant  is  used. 
Analytically,  affine  transformations  capture  the  motion  of  a  plane  under  orthography.  In  practice,  affine 
transformations  of  an  image  have  been  widely  used  in  computer  vision  to  compensate  for  viewpoint 
changes  in  cases  where  the  relief  of  an  object  is  small  compared  to  the  viewing  distance,  such  a  model  is 
especially  popular  in  the  analysis  of  aerial  imagery. 

For  current  concerns,  matters  can  be  formalized  with  reference  to  a  set  of  four  image  regions  and  their 
centroids.  Three  of  the  region  centroids  are  used  to  establish  a  two-dimensional  basis;  the  coordinates  of 
the  fourth  centroid  are  projected  on  the  basis  to  achieve  affine  invariance.  Notice  that  given  a  basis  set 
defined  in  terms  of  3  regions,  it  is  possible  to  represent  an  arbitrary  number  of  additional  regions  in  terms 
of  the  established  basis  set.  In  the  current  work,  a  single  additional  region  is  employed  to  investigate  the 
discriminatory  power  of  a  small  set  of  regions;  thus,  the  relative  geometry  of  the  four  patches  is  captured 
by  the  pair  of  numbers,  a  and  b. 

Working  with  a  set  of  four  image  regions  leads  to  twelve  different  ways  to  specify  a  basis  set  for 
specifying  the  affine  invariant  coordinates  of  the  remaining  region  (i.e.,  12  ways  to  choose  3  distinct 
items  from  a  set  of  4).  Following  previous  work  [27],  the  reference  image  database  is  built  with 
redundancy,  so  that  for  each  model  (i.e.,  reference  image  represented  by  4  texture  patches)  12  database 
entries  are  created,  one  for  each  choice  of  basis  points.  Subsequently,  given  a  video  probe  characterized 
by  four  texture  patches,  any  three  patches  can  be  selected  to  define  the  basis  for  the  pair,  ( a,b ),  that  is  to 
be  compared  to  the  database:  All  possible  choices  are  represented  in  the  database.  In  practice,  the  set  of 
three  centroid  coordinates  that  most  nearly  yields  an  orthogonal  frame  is  selected  as  it  will  be  relatively 
resilient  to  centroid  localization  errors. 

Combined  appearance  and  geometry:  To  combine  geometry  with  appearance,  geometry  is  used  as  a 
prefilter  for  appearance-based  matching.  In  particular,  coarse  quantization  of  the  geometric  parameters, 
( a ,  b),  are  used  to  define  a  two-dimensional  look-up  table.  Each  cell  in  the  table  is  filled  with  the 
appearance  vectors  (i.e.,  oriented  energy  vectors)  for  reference  images  whose  derived  geometric 
parameters  are  covered  by  the  cell’s  range.  During  matching,  a  probe  indexes  a  cell  based  on  its  recovered 
geometric  parameters;  subsequently,  the  best  match  is  based  on  the  largest  inner  product  between  the 
appearance  vector  of  the  probe  and  all  appearance  vectors  contained  in  the  indexed  cell. 

Empirical  results:  This  section  describes  an  experiment  that  evaluates  the  effectiveness  of  the  proposed 
approach  for  matching  video  probes  to  a  reference  image  database.  Individual  database  entries  and  probes 
are  characterized  in  terms  of  quadruples  of  texture-defined  image  regions.  The  appearance  of  individual 
patches  is  captured  via  their  16  dimensional  oriented  energy  vectors.  The  relative  geometry  of  patches  is 
captured  via  their  2  dimensional  affine  invariants. 

The  database  was  constructed  from  orthoimages  corresponding  to  5  different  geographical  locations.  The 
orthoimages  were  captured  in  the  visible  portion  of  the  spectrum  at  8-bits/pixel  intensity  resolution  and  at 
approximately  1  ground  meter/pixel  spatial  resolution.  The  affine  parameters  were  uniformly  quantized 
into  bins  of  size  0.5,  with  1.0  overlap  between  adjacent  bins.  These  units  were  chosen  based  on  empirical 
inspection  so  as  to  ensure  that  geometric-based  match  pruning  would  run  the  gambit  between  providing 
almost  complete  disambiguation  of  match  to  no  disambiguation  of  match.  Once  populated  the  database 
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consisted  of  587  distinct  entries  (derived  from  subregions  with  the  5  orthoimages)  For  illustrative 
purposes,  Figure  1  shows  imagery  for  an  example  database  entry. 


The  probes  were  constructed  as  synthetic  flyovers  of  regions  corresponding  to  the  5  orthoimages  used  to 
construct  the  database.  For  each  region,  flyovers  were  generated  in  two  directions  (e.g.,  strips  flown 
north-south  or  east-west),  at  3  spatial  resolutions  (where  image  support  and  resolution  allowed)  and  2 
obliquities  (nadir  and  30  degrees  off  nadir).  Overall,  a  set  of  32  probes  resulted.  For  illustrative  purposes, 
Figure  2  shows  imagery  for  a  probe  that  corresponds  to  the  database  entry  shown  in  Figure  1. 

Overall,  when  the  32  probes  were  indexed  into  the  database  by  the  described  method,  it  was  found  that 
the  top  ranked  match  was  the  correct  match  75%  of  the  time.  Further,  the  correct  match  was  within  the 
top  2  ranked  matches  88%  of  the  time  and  within  the  top  3  ranked  matches  100%  of  the  time.  Also 
considered  were  attempts  to  index  based  purely  on  the  basis  of  appearance  (i.e.,  ignoring  the  geometric 
pre filter);  in  this  case  inferior  match  accuracy  was  observed,  which  underlines  the  importance  of  joint 
consideration  of  appearance  and  geometry  in  image  indexing. 

Summary:  In  this  report  a  method  was  presented  for  matching  between  aerial  video  and  corresponding 
reference  orthoimagery,  as  typical  of  geospatial  databases.  The  method  combines  image  appearance, 
characterized  in  terms  of  texture  defined  regions,  and  image  geometry,  characterized  in  terms  of  spatial 
relationships  between  textured  regions.  By  construction,  the  matching  methods  are  robust  to  a  range  of 
photometric  and  geometric  distortions  between  image  sources,  including  changes  in  greylevel  contrast 
and  affine  geometric  transformations.  Empirical  investigations  suggest  the  promise  of  the  approach.  The 
developed  approach  can  serve  as  an  enabling  preprocessing  step  for  extant  approaches  to  video-to- 
reference  image  registration.  In  particular,  it  can  serve  to  initialize  automated  image  registration 
algorithms  by  providing  approximate  spatial  position  of  the  video  relative  to  the  reference.  An  important 
direction  for  future  research  is  to  subject  the  method  to  additional  empirical  evaluation,  especially 
evaluation  that  employs  real  operational  data. 
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Figure  13.  Example  Database  Entry.  The  left  panel  shows  an  original  orthoimage.  The  right  panel  shows 
the  automatically  selected  regions  of  interest  with  overlaid  geometric  symbols  (circle,  ellipse,  square, 
triangle)  highlighting  a  quadruple  corresponding  to  a  single  database  entry. 
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Figure  14.  Example  Video  Probe.  The  top  panel  shows  a  single  frame  of  a  flyover  of  a  portion  of  the 
orthoimage  shown  in  Figure  1.  The  middle  panel  shows  an  image  mosaic  of  the  flyover  video.  The  bottom 
panel  shows  the  automatically  selected  regions  of  interest  with  overlaid  geometric  symbols  (circle, 
ellipse,  square,  triangle)  highlighting  the  correspondence  to  the  database  entry  in  Figure  13. 
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6.2  AVS  LIDAR  for  detecting  obstacles  inside  aerosol 
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^ Presented  paper  (photograph  below) 


Abstract:  The  ability  to  detect  obstacles  or  ground  inside  aerosols  that  are  small  particles  suspended  in 
the  atmosphere  is  a  highly  sought-after  feature  for  numerous  helicopter  operations.  Helicopter  pilots  need 
visual  assistance  for  safe  flight  and  landing  during  white-out  conditions  that  can  be  produced  by  natural 
weather  phenomenon  such  as  fog  or  a  snow  storm,  or  can  be  formed  by  circling  snow  clouds  generated  by 
a  helicopter’s  rotorwash.  Similarly  helicopter  pilots  need  to  see  obstacles  or  ground  under  brown-out 
conditions,  in  which  dust  clouds  are  generated  by  a  helicopter’s  rotorwash  during  landing  on  a  sandy  area. 
This  paper  describes  a  specially  designed  AVS  LIDAR  for  detecting  obstacles  inside  aerosols  for 
helicopter  operation. 

AVS  (Augmented  Visionic  System)  is  a  vision  assistant  system  designed  to  help  helicopter  pilots 
navigate  under  extremely  poor  weather  conditions.  One  of  the  key  aspects  of  AVS  is  the  utilization  of 
active  sensors  to  detect  obstacles  and  provide  scenes  behind  aerosols  under  poor  weather  conditions. 
Since  LIDAR  can  use  the  gating  function  of  timing  discrimination  to  suppress  the  effect  of  scattering 
from  dust  and  fog,  it  can  generally  “see”  farther  than  passive  sensors  such  as  human  eyes  and  IR  cameras, 
complimenting  passive  sensors  for  AVS.  The  challenge  of  using  a  LIDAR  under  aerosol  conditions  is  not 
only  the  requirement  of  high  laser  power  for  penetrating  aerosols,  but  also  the  requirement  of  high 
detection  dynamic  range  and  the  suppression  of  aerosol  scattering  in  front  of  the  LIDAR.  Although  flash 
LIDARs  or  gated  laser  cameras  can  use  timing-discrimination  functions  to  suppress  the  signals  from 
aerosols,  they  generally  don’t  have  enough  optical  power  to  penetrate  aerosol  and  to  cover  a  reasonably 
large  area.  Conventional  scanning  LIDARs  have  been  used  to  detect  obstacles  inside  aerosol  with  limited 
success.  They  normally  use  optics  that  has  a  co-aligned  launching  beam  and  returning  beam  before  the 
scanning  optics.  Consequentially,  the  returning  beam  from  a  target  is  always  imaged  back  onto  the 
receiver  regardless  of  the  range  to  target.  The  scattering  from  aerosol  in  front  of  a  LIDAR  window  can 
saturate  the  receiver  before  any  further  signal  processing  can  occur.  Neptec  AVS  LIDAR  uses  an 
autosynchronized  optical  design,  which  utilizes  a  triangulation  relationship  to  control  the  amount  of 
returning  beam  accepted  by  the  TOF  (time-of-flight)  receiver  as  a  function  of  target  range.  The  design 
also  maintains  this  property  during  high-speed  optical  scanning.  As  a  result,  AVS  LIDAR  can  suppress 
the  return  signals  from  nearby  aerosol  scattering  and,  at  the  same  time,  have  a  sensitivity  and  dynamic 
range  to  detect  obstacles  or  ground  inside  aerosol.  Neptec  has  conducted  experiments  to  study  the  effect 
of  atmospheric  aerosols  scattering  on  LIDAR,  FLIR  and  human  vision  by  using  a  propagation  and  aerosol 
evaluation  corridor  at  DRDC  Valcartier,  Quebec,  Canada.  Neptec  has  also  carried  out  flight  tests  of  a 
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concept  AVS  LIDAR  on  a  NRC  Bell  412  helicopter  around  the  shore  of  the  Crash  Lake  located  in  the 
north  of  Ottawa,  Canada.  In  this  paper,  the  concept  of  the  AVS  LIDAR  that  is  uniquely  designed  to 
penetrate  aerosols  and  its  applications  in  helicopter  landing  will  be  described;  and  the  results  on  aerosol 
penetration  and  obstacle  detection  will  be  discussed. 
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6.3  Experimental  validation  of  an  NVD  parametric  model 
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Overview  and  Purpose:  As  part  of  the  effort  to  create  realistic  synthetic  imagery,  it  is  important  to 
accurately  model  fluctuations  in  the  NVG  output  signal  for  weak,  uniform  input  irradiance.  The  NVG 
model  was  designed  to  facilitate  comparisons  with  laboratory  experiments.  In  particular,  the  model 
created  synthetic  “weak-signal  NVG  images”  of  a  scene  one  photon  event  at  a  time  by  a  statistical 
treatment  of  the  creation  of  photoelectrons  at  the  photocathode  of  the  NVG.  Temporal  and  spatial 
statistics  of  such  synthetic  imagery  could  be  compared  in  detail  to  laboratory  experimental  results.  More 
intense  NVG  images  were  treated  as  the  sum  of  a  sequence  of  weak-signal  images,  where  the  NVG 
parameters  could  vary  between  images.  This  methodology  allowed  the  modeling  of  point  spread  (optical 
and  NVG  halo)  and  automatic  gain  control  in  a  manner  that  was  convenient  for  comparisons  with 
experiments.  This  work  describes  a  weak-signal  model  that  was  used  to  create  synthetic  imagery.  The 
synthetic  imagery  was  then  evaluated  using  statistical  parameters  calculated  from  the  imagery. 
Comparisons  were  made  with  laboratory  measurements,  down  to  the  single-photon  level  of  signal.  Of 
particular  interest  was  the  spatial/temporal  probability  of  photoelectron  creation. 

Background:  In  military  simulators,  frame  rate  and  spatial  resolution  considerations  can  limit  the  time 
available  for  the  generation  of  each  frame  of  an  NVD  scene  model.  It  is  expected  that  there  will  be  a 
concomitant  reduction  in  image  ‘fidelity’.  For  psycho-physical  experiments,  small  effects  can  sometimes 
bias  the  results  in  a  highly  nonlinear  manner,  so  that  image  ‘fidelity’  is  expected  to  be  important.  Hence, 
it  is  desirable  to  verify  that  synthetic  images  (from  a  simulator)  being  used  for  such  experiments  are  free 
of  spatial  or  temporal  anomalies  that  are  generated  by  the  simulation  process  itself.  A  ‘laboratory  model’ 
of  NVG  output  need  not  have  severe  constraints  on  frame  rate  or  spatial  resolution,  and  so  can  take  the 
time  needed  to  accurately  model  the  physical  processes  within  the  NVD.  An  image-generation  process 
that  closely  follows  the  physical  processes  involved  in  the  NVD  is  expected  to  provide  better  ‘fidelity’ 
than  a  generator  for  which  operating  speed  or  other  parameters  are  the  most  important  design  criteria. 
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An  important  example  is  the  signal  shot  noise  due  to  the  Poisson  random  process  by  which  photoelectrons 
are  generated.  The  fundamental  physics  of  the  creation  of  an  isolated  photoelectron  is  well  known.  With 
a  sufficiently  weak  input  irradiance,  each  channel  of  the  image  intensifier  of  the  NVG  can  be  considered 
independent,  and  sequential  signals  on  the  same  channel  can  be  made  far  enough  apart  (on  average)  as  to 
also  be  independent.  This  approach  uses  the  assumption  that  photoelectron  events  pass  through  the  NVG 
very  rapidly  compared  to  the  average  time  between  events  or  to  the  time  for  recovery  of  an  NVG  channel 
after  an  electron-multiplication  event. 

The  ‘weak-signal’  assumption  was  met  for  typical  irradiance  conditions  by  choosing  a  short-enough  time 
duration  (a  ‘time  slice’)  for  the  application  of  the  model.  The  process  was  repeated  for  subsequent  time 
slices.  Between  time  slices,  the  state  of  the  NVG  (eg  the  gain)  could  be  varied  to  match  the  expected 
physical  effects.  The  photosignals  from  different  time  slices  were  summed  to  give  the  total  output  over 
the  desired  integration  time  (eg  50  msec).  While  this  method  for  modeling  NVG  output  is  easily  justified 
from  a  physics  standpoint,  it  can  take  significant  computational  time  if  the  time  slice  is  small  compared  to 
the  integration  time,  and  so  the  method  is  not  generally  useful  for  a  real-time  simulation.  However,  the 
realism  of  the  model  is  expected  to  be  excellent,  and  can  be  compared  to  experiments  at  the  lowest  level 
of  signal  -  the  creation  of  a  single  photo-electron.  Measures  for  ‘realism’  are  needed,  and  these  measures 
must  be  quantitatively  verifiable  in  the  laboratory. 

Suitable  laboratory  physical  (as  opposed  to  psycho-physical)  experiments  can  validate  such  a  ‘time-slice 
model’  and  can  point  out  statistical  characterizations  of  the  synthetic  imagery  that  are  sensitive  indicators 
of  inappropriate  model  behaviour.  Once  a  robust  set  of  characterizers  has  been  developed,  it  can  be 
applied  to  simulator  outputs  to  identify  potential  anomalies. 

Laboratory  Evaluation  System: 

a)  Photon  Events:  To  measure  the  statistics  of  the  (highly  non-uniform)  images  created  from  weak 
photosignals  from  a  uniform  source,  the  response  of  an  NVG  to  individual  photon  events  was  measured 
by  reimaging  part  of  the  fluorescent  screen  of  the  NVG  onto  a  photomultiplier.  The  photomultiplier  noise 
was  readily  distinguished  from  the  NVG  signal  at  the  output  of  the  fluorescent  screen  by  a  binary 
threshold  on  signal  amplitude.  (The  means  and  halfwidths  of  the  two  amplitude  distributions  are  generally 
very  different.)  This  method  was  a  sensitive  measure  of  NVG  temporal  response  at  light  levels  low 
enough  that  individual  photon  events  were  well  separated  in  time.  Both  the  experiments  and  the  weak- 
signal  model  measured  individual  photo-electron  creation  events,  and  so  the  model  could  be  compared  to 
experiment  at  the  most  fundamental  level. 

b)  Halo  Imagery:  For  measurements  of  the  spatial  response  of  an  NVG  to  a  localized  light  source,  a 
camera  replaced  the  NVG  eyepiece  and  recorded  an  image  of  the  fluorescent  screen  (of  the  NVG).  The 
amplitude  of  the  light  source  could  be  varied  over  5  decades  by  pulse-width  modulation. 

c)  Temporal  Behaviour:  A  ‘pump-probe’  configuration  of  the  light  source  in  the  camera  setup  was  used 
to  examine  the  temporal  behaviour  of  the  NVG  parameters,  particularly  the  automatic  gain  control 
(AGC),  at  higher  signal  levels. 

Statistics  of  Photon  Events:  The  photomultiplier  apparatus  was  able  to  measure  the  response  of  the 
NVG  to  single-photon  events  with  a  time-resolution  of  better  than  10  microseconds.  The  spatial 
resolution  was  adjustable.  Only  a  single,  contiguous  region  of  the  fluorescent  screen  of  the  NVG  was 
imaged  at  any  time.  From  the  time  decay  of  the  single-photon  events,  the  decay  constant  of  the 
fluorescent  screen  was  determined.  Histograms  of  the  time  between  photon  events  and  event  amplitudes 
validated  the  Poisson  nature  of  the  photodetection  process  in  the  NVG  and  provided  experimental  data  for 
sensitive  comparisons  of  modeled  imagery  against  those  from  a  physical  NVG. 
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Halo  Imagery  and  temporal  behaviour:  A  commercial  digital  camera  was  used  to  record  the  output  of 
the  fluorescent  screen  of  the  NVG  in  response  to  a  light  source  whose  range,  aperture  and  intensity  could 
be  precisely  controlled.  Average  intensity  was  precisely  varied  by  changing  the  duty  cycle  of  the  LED 
light  source,  which  was  operated  in  pulsed  mode.  The  apparatus  could  model  halo  phenomena.  A 
second,  synchronized,  light  source  was  used  to  set  the  state  of  the  automatic  gain  control  of  the  NVG.  By 
control  of  the  timing  of  the  light  sources,  the  temporal  behaviour  of  the  automatic  gain  control  of  the 
NVG  was  experimentally  determined. 
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7  Technologies 


7.1  Developpement  d’un  engin  de  projection  de  format  VGA  base 
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compatible  avec  le  standard  DVI 
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Introduction  :  Le  developpement  d’un  engin  de  projection  de  format  VGA  base  sur  les  Modulateurs 
Analogues  Reflectifs  Flexibles  (FRAM)  et  compatible  avec  le  standard  DVI  est  rapporte.  La  technologie 
FRAM  a  ete  developpee  il  y  a  quelques  annees  [12,  13,  14,  15].  Cette  technologie  repose  sur  des  micro- 
miroirs  simples  produits  en  utilisant  des  procedes  typiques  pour  la  fabrication  des  MOEMS.  Elle  a 
l’avantage  d’offrir  un  procede  de  production  simple  (3  niveaux  de  masquage),  un  temps  de  reponse  rapide 
(moins  de  5  ps)  et  d’etre  insensible  a  la  longueur  d’onde  d’operation  sur  de  grandes  plages  spectrales.  De 
plus,  la  modulation  de  la  lumiere  avec  ces  micro-dispositifs  ne  demande  pas  de  realiser  des  micro-miroirs 
presentant  un  etat  plan  de  tres  haute  qualite  optique  difficile  a  obtenir  mais  necessaire  pour  d’autres 
technologies  de  modulation  basees  sur  les  MOEMS. 

Tests  et  selection  de  barrettes  de  FRAM  pour  la  mise  en  boitier  :  Un  defi  principal  du  developpement 
de  l’engin  de  projection  etait  la  mise  en  boitier  de  puces  FRAM  presentant  un  grand  nombre  de  signaux 
d’entree  (481).  Pour  la  mise  en  boitier  de  telles  puces,  l’approche  puce-sur-carte  a  ete  selectionnee.  Des 
barrettes  de  FRAM  480  x  1  appropriees  pour  cette  approche  de  mise  en  boitier  ont  ete  congues,  fabriquees 
et  testees  (Figure  1).  De  tres  grandes  barrettes  (4000  x  1)  (Figure  2)  ont  aussi  ete  produites  durant  la 
periode  de  fabrication  ce  qui  a  continue  la  faisabilite  de  telles  barrettes.  Les  tests  en  eux-memes 
representaient  un  defi.  En  effet,  il  etait  critique  de  selectionner  une  barrette  de  FRAM  480  x  1  avec  un 
pourcentage  de  fonctionnement  des  pixels  aussi  haut  que  possible.  Atteindre  ce  but  impliquait  que  les 
barrettes  de  FRAM  fabriquees  devaient  etre  inspectees  et  testees  avec  soin.  En  pratique,  tester  tous  les 
FRAM  de  plusieurs  barrettes  480  x  1  avant  la  mise  en  boitier  n’est  pas  simple.  La  difficulty  ici  est  que  le 
temps  et  le  cout  requis  pour  ces  tests  doivent  demeurer  raisonnables.  Ceci  requiert  que  plusieurs  FRAM 
soient  actives  et  testes  en  meme  temps.  L’activation  de  plusieurs  FRAM  (60)  a  ete  realisee  avec  une  carte 
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a  pointes  congue  sur  mesure  combinee  a  une  station  de  test.  La  reponse  des  FRAM  actives  etait  observee 
a  l’aide  d’un  banc  de  test  optique  integre  a  la  station  de  test.  Ce  banc  de  test  etait  une  version  reduite  et 
legerement  modifiee  du  systeme  optique  utilise  dans  un  projecteur.  Une  ligne  de  lumiere  illuminait 
plusieurs  FRAM  et  la  lumiere  reflechie  par  les  FRAM  passait  a  travers  une  optique  Schlieren  pour 
produire  des  pixels  dans  le  plan  image  localise  a  la  sortie  d’un  relai  optique.  Une  camera  et  un  moniteur 
produisaient  une  image  agrandie  des  pixels.  Ceci  fournissait  une  fagon  commode  pour  verifier  le 
fonctionnement  de  milliers  de  FRAM  relativement  vite  en  observant  les  changements  d’intensite  des 
pixels  quand  le  voltage  applique  aux  FRAM  etait  varie.  La  Figure  3  presente  le  montage  de  test  complet 
(station  de  test,  carte  a  pointes  et  module  optique) 

Mise  en  boitier  d’une  barrette  de  FRAM  :  Une  barrette  de  FRAM  480  x  1  a  ete  selectionnee  pour  la  mise 
en  boitier  finale  en  utilisant  cette  methode  combinee  a  des  mesures  complementaires  realisees  avec  un 
microscope  interferometrique.  Un  assemblage  carte  flexible/boitier  metallique  a  ete  utilise  pour  implementer 
l’approche  de  mise  en  boitier 


Figure  15.  Barrettes  de  FRAM  avec  une  membrane  de  300  nm  d’epaisseur. 
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Figure  16.  Barrette  de  FRAM  4000x1 


Figure  17.  Barrette  de  FRAM  480  x  1  en  boitier. 

puce-sur-carte  selectionnee  (Figure  3).  A  l’interieur  de  l’assemblage,  chaque  FRAM  est  connecte 
electriquement  a  la  carte  de  circuit  imprime  flexible  par  microcablage.  Un  boitier  place  par-dessus  la 
barrette  de  FRAM  et  serre  sur  la  carte  fournit  une  enceinte  hermetique  permettant  V  operation  de  la 
barrette  de  FRAM  dans  une  atmosphere  inerte  d’azote  sec.  II  procure  aussi  une  protection  mecanique  a  la 
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barrette.  II  est  equipe  d’une  fenetre  optique.  De  petites  ouvertures  d’ entree  et  sortie  refermables 
permettent  la  regeneration  de  l’atmosphere  inerte  si  necessaire. 

Electronique,  logiciel  de  controle  et  assemblage  final  :  Le  lien  entre  l’assemblage  puce-sur-carte  et 
l’electronique  de  controle  est  assure  par  des  connecteurs  standards  presentant  un  nombre  eleve  de  broches 
de  raccordement.  Cette  electronique  de  controle  sur  mesure  et  le  logiciel  de  controle  associe  ont  ete 
developpes  pour  permettre  le  transfert  des  donnees  des  images  vers  la  barrette  de  modulateurs. 
L’electronique  de  controle  comprend  une  carte  DAC,  une  carte  FPGA  et  une  carte  d’alimentation. 
L’electronique  congue  et  le  logiciel  associe  sont  compatibles  avec  le  standard  Digital  Video  Interface 
(DVI).  Cela  permet  la  projection  d’une  variete  d’images  incluant  des  images  fixes  et  des  sequences 
d’animation.  Avec  l’engin  de  projection  resultant,  des  images  de  definition  VGA  peuvent  etre  affichees  a 
une  cadence  de  60  Hz. 

Une  partie  de  l’electronique  de  controle  et  le  boitier  sont  montes  sur  des  supports  de  positionnement.  Ces 
supports  permettent  un  alignement  optique  precis  de  la  barrette  de  FRAM.  Le  plein  fonctionnement  de 
l’engin  a  ete  verifie  en  l’integrant  (Figure  5)  a  un  banc  de  test  existant  et  en  projetant  des  images  fixes  et 
des  animations. 


Figure  18.  Le  module  optique  integre  a  la  station  de  test  equipee  d’une  carte  a pointes  congue  sur 

mesure. 
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7.2  Brillance  et  contraste  des  images  projetees  par  des  projecteurs 
video  a  laser 


Michel  Doucet1*,  Melanie  Leclerc*,  Francis  Picard*,  et  Keith  K.  Niall** 


*INO,  Quebec  City,  Quebec 

**  Recherche  et  developpement pour  la  defense  Canada  -  Toronto 
^ Papier  presente  (photographic  ci-dessous) 


Introduction  :  Les  projecteurs  video  a  laser  (LB VP)  sont  relativement  nouveaux  sur  la  scene  de 
faffichage  video.  De  tels  projecteurs  utilisent  des  faisceaux  laser  qui  sont  balayes  et  modules  en 
synchronisme  avec  le  balayage.  Une  particularity  du  LBVP  est  la  duree  de  vie  tres  courte  des  pixels. 
Chaque  pixel  produit  de  la  lumiere  seulement  durant  le  temps  tres  court  correspondant  au  passage  du 
rayon  laser  sur  le  pixel.  Les  variations  tres  rapides  du  signal  optique  font  en  sorte  qu’il  est  plus  difficile  de 
mesurer  les  proprietes  des  images  produites  par  LBVP  en  comparaison  avec  le  cas  des  dispositifs 
d'affichage  conventionnels.  On  peut  meme  douter  de  la  validite  des  resultats  lorsque  des  methodes 
conventionnelles  sont  employees  pour  mesurer  les  caracteristiques  des  images  produites  par  un  LBVP. 
Cet  article  presente  une  methode  alternative  pour  la  caracterisation  de  la  brillance  et  du  contraste  des 
images  de  LBVP  qui  devrait  foumir  des  resultats  plus  fiables. 

Methode  conventionnelle  :  L'evaluation  de  la  brillance  et  du  contraste  d?un  affichage  se  fait 
conventionnellement  en  utilisant  un  telephotometre.  Comme  son  nom  l’indique,  le  telephotometre  permet 
la  mesure  de  la  lumiere  a  partir  d’un  point  eloigne.  Le  telephotometre  se  compose  d'une  lentille  qui 
projette  fimage  de  la  scene  sur  un  detecteur  et  de  deux  pupilles  qui  definissent  fenveloppe  effective  du 
faisceau  de  lumiere  qui  parvient  jusqu’au  detecteur.  Dans  le  contexte  de  la  caracterisation  d'un  dispositif 
d’  affichage,  le  telephotometre  est  pointe  sur  une  petite  portion  de  fecran  et  collecte  les  rayons  venant 
uniquement  de  cette  zone  d'observation.  Seulement  une  fraction  de  la  puissance  optique  atteint  le 
detecteur  du  telephotometre.  Dans  le  cas  de  LBVP,  il  est  difficile  de  mesurer  le  signal  optique  puisqu’il 
est  relativement  faible  et  comprend  de  tres  rapides  variations  de  puissance. 

Methode  alternative  proposee  :  Un  signal  optique  a  variation  rapide  peut  etre  mesure  et  caracterise  avec 
precision  a  condition  d’etre  assez  fort.  Afin  de  faciliter  la  mesure  des  caracteristiques  des  images  de 
LBVP,  il  y  aurait  avantage  a  changer  le  paradigme  de  detection  de  maniere  a  assurer  un  plus  fort  signal 
optique  sur  le  detecteur  de  l’appareil  de  mesure.  La  methode  alternative  proposee  vise  a  atteindre  ce  but. 
Cette  methode  alternative  implique  de  mesurer  l’eclairement  (puissance  optique  par  unite  de  surface)  dans 
le  plan  situe  juste  devant  fecran  [16].  La  radiance  ou  la  luminance  est  alors  determinee  par  calcul  en 
utilisant  les  mesures  des  proprietes  de  reflectivite  de  fecran. 
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Dans  la  methode  proposee,  feclairement  est  mesure  a  differents  points  dans  le  plan  ou  la  surface  situee 
immediatement  devant  la  surface  normalement  occupee  par  fecran.  La  figure  de  test  proposee  pour  la 
mesure  est  un  echiquier  de  10  carreaux  (5  eclaires,  5  noirs)  sur  10.  La  mesure  de  feclairement  est 
effectuee  au  milieu  de  chacun  des  carreaux  brillants.  Pour  chaque  position  d’echantillonnage,  une 
premiere  mesure  est  effectuee  pour  la  valeur  maximum  de  Feclairement,  et  une  seconde  est  effectuee  pour 
la  valeur  minimum  avec  la  figure  de  test  en  inverse  video. 

Certains  types  d’ecrans  modemes  possedent  des  microstructures  permettant  le  controle  des  proprietes 
directionnelles  de  dispersion  de  la  lumiere.  Pour  de  tels  ecrans,  les  proprietes  de  dispersion  dependent 
generalement  de  la  direction  incidente  de  fillumination.  La  representation  mathematique  des  proprietes  de 
la  reflectivite  de  fecran  qui  est  employee  pour  le  calcul  de  luminance  est  la  fonction  de  distribution 
bidirectionnelle  de  la  reflectivite  (BRDF)  [17].  La  BRDF  donne  la  radiance  reflechie  par  unite 
d'eclairement  incident  pour  n'importe  quelle  direction  de  reflexion  et  n'importe  quelle  direction 
d'illumination.  II  existe  des  appareils  specialises  permettant  la  mesure  de  la  distribution  spectrale  de  la 
BRDF  de  fagon  efficace.  La  methode  implique  qu'une  portion  de  fecran  soit  sacrifice  pour  la  mesure  de  la 
BRDF.  Disposant  de  la  BRDF  spectrale  de  fecran  et  d’un  echantillonnage  de  feclairement  d'ecran,  la 
luminance  peut  etre  determinee  pour  n’importe  quelle  position  d'observateur  et  n’importe  quel  point  sur 
fecran  en  utilisant  un  logiciel  dedie. 


Figure  19.  Description  schematique  de  la  methode. 


Considerations  pratiques  :  Certains  aspects  pratiques  doivent  etre  consideres  pour  la  mise  en  oeuvre  de 
la  methode  proposee.  Les  plus  importants  concernent  la  lumiere  parasite  et  V echantillonnage.  La  lumiere 
parasite  peut  avoir  un  impact  significatif  sur  les  resultats  et  les  echantillonnages  spatial  et  temporel  du 
signal  optique  peuvent  egalement  occasionner  des  erreurs  s’ils  ne  sont  pas  faits  correctement. 

La  lumiere  parasite  est  produite  par  le  projecteur  lui-meme  et  par  fenvironnement  ambiant.  Le  voile 
lumineux  (veiling  glare)  est  genere  par  des  reflexions  indesirables  sur  les  surfaces  optiques  de  fobjectif  et 
sur  les  pieces  mecaniques  du  projecteur.  II  augmente  avec  la  quantite  totale  de  puissance  optique  contenue 
dans  fimage  projetee.  L’illumination  ambiante  et  la  retroreflexion  sur  les  murs  et  les  objets  sont  les  deux 
principals  sources  de  lumiere  parasite  causee  par  fenvironnement.  Une  telle  lumiere  parasite  est 
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specifique  au  lieu  ou  se  fait  la  projection.  La  retroreflexion  parasite  se  produit  quand  la  lumiere  venant  de 
fecran  est  retroreflechie  vers  l’ecran  par  les  murs  et  les  objets  presents  dans  la  piece.  La  lumiere  parasite 
affecte  considerablement  le  contraste  de  fimage  projetee  puisqu'elle  ajoute  une  intensite  de  fond  sur 
fecran.  L’echiquier  de  10  par  10  a  ete  choisi  de  maniere  a  produire  l’inevitable  voile  lumineux  dans  une 
proportion  representative  de  ce  que  Ton  retrouve  dans  le  cas  de  la  projection  d’une  image  normale.  Une 
telle  figure  de  test  contient  environ  la  moitie  de  la  puissance  optique  maximum  disponible  et  produirait 
done  environ  la  moitie  de  la  quantite  de  voile  lumineux  possible.  Le  choix  d'une  figure  de  test  avec  moins 
de  puissance  optique  reduirait  la  quantite  de  voile  lumineux  produit  et  resulterait  en  une  estimation  du 
contraste  qui  serait  non  representative  du  contraste  pour  une  image  type.  La  deterioration  du  signal  par  la 
lumiere  parasite  de  cause  environnementale  change  d'un  endroit  a  f  autre  et  constitue  done  un  probleme 
pour  la  standardisation  des  mesures.  Heureusement,  il  existe  des  techniques  simples  pour  surmonter  de 
tels  problemes.  La  contribution  de  la  lumiere  parasite  dependante  de  fenvironnement  peut  etre  mesuree  et 
puis  soustraite  du  signal  utile.  Ceci  est  fait  en  mettant  le  detecteur  optique  dans  fombre  d’un  masque 
opaque  noir.  La  lumiere  du  projecteur  (voile  lumineux  compris)  est  bloquee  et  seulement  fillumination 
ambiante  et  la  retroreflexion  parasite  peut  atteindre  le  detecteur  optique. 

Le  procede  d’echantillonnage  requis  pour  la  caracterisation  d’un  phenomene  doit  pouvoir  tenir  compte  de 
la  distribution  spatiale  aussi  bien  que  des  fluctuations  temporelles  du  phenomene  en  question.  Dans  le  cas 
de  la  caracterisation  d’une  image  LB  VP,  une  attention  particuliere  doit  etre  portee  aux  problemes  lies  au 
tramage  de  fimage  et  aux  variations  rapides  du  signal  optique  dues  au  balayage.  Selon  la  technologie  de 
LBVP,  il  peut  y  avoir  des  zones  mortes  entre  les  pixels  ou  a  finterieur  de  chacun  d’eux.  De  telles 
structures  periodiques  peuvent  induire  des  erreurs  de  mesure  lorsque  les  dimensions  du  detecteur  optique 
ne  comprennent  pas  un  nombre  entier  de  periodes  de  la  structure.  Selon  la  position  du  detecteur  optique 
relativement  a  la  matrice  de  pixels,  un  nombre  plus  ou  moins  important  de  zones  mortes  sont  inclues  dans 
la  surface  active  du  detecteur.  Ceci  signifle  que  le  signal  depend  de  la  position  relative  du  detecteur 
optique  relativement  au  treillis  de  pixels.  Ces  eventuels  problemes  d’echantillonnage  spatial  peuvent  etre 
evites  si  certaines  regies  simples  sont  respectees.  Ces  regies  concement  le  nombre  de  pixel  contenus  dans 
la  surface  efficace  du  detecteur  optique,  la  forme  du  detecteur  et  son  orientation  par  rapport  a 
l’agencement  des  pixels  de  1’ image. 
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Modelisation  et  simulation  de  sources  lumineuses 


Jeff  Clark',  Brett  Chladny,  Brad  Colbert,  et  Karl  Mathia 

Renaissance  Sciences  Corporation,  Chandler,  Arizona,  USA 
1 Papier  presente  (photographie  ci-dessous) 


Selon  les  circonstances,  les  principales  sources  de  lumiere  d’une  scene  nocturne  sont  l’eclairage  urbain, 
les  effets  des  combats  et  les  vehicules.  Dans  les  environnements  vises,  l’efficacite  des  capteurs  optiques 
est  considerablement  et  diversement  affectee,  positivement  ou  negativement,  par  la  quantite,  le  type, 
l’intensite,  la  position,  l’habillage  et  l’orientation  de  ces  sources.  Or,  les  techniques  classiques  de 
simulations  reproduisent  avec  peu  de  precision  les  sources  de  lumiere  et  de  leur  interaction  avec  les  autres 
elements  de  la  scene.  Bien  que,  dans  le  passe,  elles  aient  ete  sufflsantes  pour  les  besoins  modestes  de 
formation  aux  scenes  hors  de  l’aeronef,  les  techniques  classiques  de  rendu  des  sources  ponctuelles 
laissent  beaucoup  desirer  au  plan  de  la  reconstitution  des  difficultes  d’utilisation  des  capteurs  a 
amplification  d’ image  aux  fins  de  la  connaissance  de  la  situation,  dans  les  environnements  complexes  des 
missions  actuelles.  Actuellement,  on  accorde  une  forte  priorite  aux  missions  a  basse  altitude  en  terrain 
urbain  comme  l’appui  aerien  rapproche  (AAR)  ou  la  cherche  et  sauvetage  de  combat  (RESCO).  Or,  si 
nous  voulons  assurer  avec  nos  simulateurs,  une  formation  aux  elements  de  ces  missions  qui  requierent 
l’utilisation  de  ces  capteurs  dans  ces  environnements  tres  complexes,  nous  devrons  disposer  de 
representations  des  sources  de  lumiere  beaucoup  plus  riches,  precises  et  denses. 

Tirant  parti  des  travaux  connexes  dans  ce  domaine,  les  travaux  de  developpement  de  la  phase  II 
integreront  les  techniques  de  modelisation  des  sources  ponctuelles,  mises  au  point  par  la  collaboration  en 
R  et  D  des  Forces  aeriennes  des  Etats-Unis  (USAF),  de  la  direction  de  l’efficacite  humaine  du  laboratoire 
de  recherches  des  Forces  aeriennes  des  Etats-Unis  (AFRL/HEA)  et  le  programme  PMA-205  du 
commandement  des  systemes  aeronavals  des  Forces  navales  des  Etats-Unis  (USN).  Nous  decrirons  les 
concepts  centraux  de  la  modelisation  des  sources  ponctuelles  avec  des  details  sufflsamment  fins  pour 
produire  des  modeles  physiques  de  rayonnement  necessaires  a  la  reproduction  de  la  complexity  de  la 
scene,  avec  la  precision  necessaire  pour  son  utilisation  lors  de  la  formation  avec  les  capteurs.  Ensuite, 
nous  presenterons  la  structure  de  stockage  en  architecture  ouverte  XML  produite  aux  fins  de  la  validation 
de  principe.  Pour  finir,  nous  presenterons  les  resultats  de  l’utilisation  de  ces  techniques  dans  un  sommaire 
de  travaux  connexes,  demontrant  les  predictions  hors-ligne  du  type,  de  l’intensite  et  de  la  position  des 
sources  ponctuelles  dans  des  champs  denses  d’eclairage  artificiel  ponctuel,  ainsi  que  la  production  de 
cartes  de  l’eclairement  du  terrain,  fondees  sur  la  physique,  pour  les  simulations. 
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8  Generation  damages 


8.1  Integration  a  une  simulation  existante  d’un  generateur 

d’images  deployable  fonde  sur  une  interface  commune  de 
generateur  d’images 


Robert  Wolfed  et  Tony  Ghoman  * 

*  Recherche  et  developpement pour  la  defense  Canada-Toronto 
f  Serenica  Technologies  Corporation  (Papier presente) 


Un  systeme  de  generation  d’images  fournit  les  images  principales  pour  les  simulations  visuelles.  II  peut 
se  repartir  entre  son  logiciel  constitutif  (generateur  d’images)  et  ses  composants  materiels  (affichage).  Le 
generateur  d’images  assure  les  fonctions  de  representation  d’images  ainsi  que  les  fonctions  d’information 
de  mission.  Le  systeme  est  souvent  caracterise  par  sa  capacite  a  offrir  une  certaine  cadence  d’images 
completes  en  fonction  d’une  definition  d’image,  d’une  complexity  visuelle  et  d’un  temps  de  latence 
donnes. 

Le  projet  ADDNS  a  produit  un  generateur  d’images  avance  pour  la  simulation  de  vol  appele  generateur 
d’images  Eagle.  Le  grand  ecran  et  la  definition  visuelle  du  projecteur  laser  Evans  et  Sutherland  connexe 
fait  de  ce  systeme  un  des  premiers  du  genre.  Le  generateur  d’images  Eagle  se  fonde  sur  le  logiciel  de 
generation  d’images  Multigen  FlightIG,  lequel  offre  une  interface  reseau  tributaire  de  l’interface 
commune  de  generateur  d’images  (CIGI).  Le  present  document  porte  sur  la  demonstration  de  l’integration 
du  nouveau  generateur  d’images  utilisant  le  CIGI  de  concert  avec  le  simulateur  multitaches  d’instruction 
de  mission  avancee  a  distance  pour  le  CF-18  situe  a  RDDC  Toronto.  En  operations  normales,  le 
simulateur  multitache  fait  appel  a  un  systeme  de  generation  d’images  MetaVR  a  canaux  multiples  avec 
affichage  sur  huit  ecrans  plats  de  projecteur  a  l’interieur  d’un  dome. 

Le  CIGI  est  un  protocole  reseau  cree  par  Boeing  qui  definit  le  format  et  le  contenu  des  paquets  CIGI, 
mais  non  la  fagon  selon  laquelle  ils  sont  communiques  sur  le  reseau.  Boeing  a  rendu  publique  sa  trousse 
de  developpement  de  logiciels  pour  le  CIGI  en  2001  afln  de  promouvoir  l’utilisation  d’une  interface  de 
generateur  d’images  ouverte  en  simulation  visuelle.  La  mise  au  point  du  logiciel  de  soutien  du  CIGI  se 
poursuit  aujourd’hui  dans  le  milieu  des  sources  ouvertes.  Le  CIGI  decoule  du  generateur  d’images,  sans 
doute  fonde  sur  le  principe  que  le  cadre  absolu  des  images  completes  du  generateur  d’images  est  fixe  ou 
tres  difficile  a  modifier,  compte  tenu  de  caracteristiques  comme  le  verrouillage  de  synchronisation. 
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Idealement,  l’hote  doit  etre  en  mesure  de  repondre  au  generateur  d’images  au  moyen  des  donnees 
convenant  a  la  frequence  du  generateur. 

Une  foule  d’elements  compliquent  l’integration  de  toute  simulation  d’hote  au  sein  d’un  generateur 
d’images.  Ces  elements  sont  complexes  des  lors  qu’il  s’agit  d’integration  a  un  hote  qui  change  d’un 
generateur  d’images  a  l’autre,  a  plus  forte  raison  lors  de  1’ integration  juxtaposee  a  un  generateur  d’images 
heterogene.  L’approche  adoptee  pour  integrer  le  generateur  d’images  Eagle  au  simulateur  multitaches 
consiste  a  juxtaposer  la  demonstration  de  la  visualisation  habituellement  utilisee  par  le  simulateur 
multitache  a  une  replique  du  premier  canal  du  generateur  d’images  Eagle  au  moyen  du  protocole  CIGI 
pour  controler  le  point  de  vue  seulement.  Une  approche  analytique  generique  visant  a  faciliter 
1’ integration  consiste  a  determiner  la  portee  du  generateur  d’images  existant,  a  la  comparer  avec  le 
nouveau  protocole  du  generateur  d’images  et  a  substituer  l’information  et  les  messages  appropries  de 
l’hote  dans  le  nouveau  protocole.  L’integration  complete  du  simulateur  multitache  au  generateur  d’images 
Eagle  est  beaucoup  plus  complexe  que  l’integration  du  point  de  vue,  et  elle  se  situe  bien  au-dela  de  la 
portee  de  la  presente  etude.  Le  processus  d’integration  suit  les  etapes  de  la  comparaison  des  messages 
graphiques  d’origine  du  simulateur  multitaches  par  rapport  aux  messages  CIGI  equivalents  (qui 
pourraient  etre  utilises  pour  determiner  la  portee  d’une  integration  complete  du  simulateur  multitaches), 
l’assemblage  d’appels  de  code  de  source  API  bien  ordonnes  du  CIGI  et  l’inclusion  des  donnees  du 
simulateur  multitaches  dans  les  messages  CIGI. 

Afin  de  faciliter  l’integration,  une  juxtaposition  des  equivalents  CIGI  aux  messages  ChannelSurfer 
utilises  par  le  simulateur  multitaches  a  ete  preparee.  Les  parametres  importants  de  chaque  type  de 
message  CIGI  sont  indiques.  Pour  les  messages  ChannelSurfer,  on  indique  si  le  message  est  generique 
(en-tete  seulement),  une  exigence  minimale  pour  les  communications  ChannelSurfer  ou  un  message 
correspondant  destine  a  la  realisation  du  protocole  d’echange. 

Les  fragments  de  codes  de  pseudo-source  foumis  montrent  quelle  sequence  d’appels  CIGI  est  necessaire 
pour  communiquer  avec  n’importe  quel  generateur  d’images.  Les  appels  sont  bases  sur  le  logiciel  libre 
CIGI  de  Boeing,  le  meme  code  exploite  par  Multigen  pour  creer  sa  propre  application  d’emulation  d’hote 
pour  le  logiciel  PlightIG.  D’autres  bribes  de  pseudo-code  montrent  comment  sont  integrees  les  valeurs  du 
simulateur  multitaches  aux  appels  CIGI  convenablement  sequences  au  sein  du  logiciel  du  simulateur 
multitaches. 

Differente  s  questions  peuvent  avoir  complique  ou  facilite  le  processus  d’integration  dont  il  est 
question  ici. 
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8.2  Avancement  de  la  technologie  des  generateurs  d’images 
generiques  evolutifs  dans  le  cadre  du  projet  de  simulation 
deployable  avance  pour  la  vision  de  jour  et  de  nuit  (ADDNS) 

Ray  M.  Obiclowski  ',  et  Rajesh  Jha 

Array  Systems  Computing  Inc.,  Toronto 
^ Papier  presente  (photographic  ci-dessous) 


Le  projet  de  demonstration  de  la  technologie  (PDT)  du  simulation  deployable  avance  pour  la  vision  de 
jour  et  de  nuit  (ADDNS)  exigeait  a  titre  essentiel  au  moins  16  generateurs  d’images  (GI)  afln  de 
rendre  des  scenes  a  60Hz  pour  un  systeme  de  projection  laser  a  tres  haute  resolution,  soit  plus 
de  20  millions  de  pixels. 

Array  Systems  Computing  Inc.  (Array)  a  adapte  son  architecture  de  processeur  de  signaux  generique 
(PSG)  avance  ScalableGPS  pour  repondre  aux  exigences  du  ADDNS.  Le  document  presente  ici  decrit 
cette  solution  GI  generique  evolutive. 

Cette  solution  comprend  une  configuration  en  grappes  Linux  d’ordinateurs  personnels  (PC)  a  16  noeuds, 
chaque  PC  etant  compose  de  materiel  commercial  integre  avec  de  multiples  unites  centrales  Opteron, 
cartes  graphiques  NVIDIA  et  composants  de  soutien. 

Pour  exploiter  le  materiel  et  utiliser  le  rendu  reparti,  Array  a  integre  le  logiciel  d’execution  Flight-IG  de 
Multigen-Paradigm  Inc.  (MPI)  et  V interface  CIGI  (Common  Image  Generator  Interface)  sous  Linux 
Centos. 

II  a  fallu  relever  un  certain  nombre  de  defis  de  genie  et  de  conception  pendant  le  developpement  du  GI- 
ADDNS  d’Array.  La  solution  finale  comprend  les  caracteristiques  suivantes  : 

1 .  Pour  Paffichage  transparent  de  plus  de  20  millions  de  pixels  sur  le  projecteur  laser  a  60  Hz,  il  fallait 
synchroniser  globalement  chaque  GI  a  moins  de  10  millisecondes  par  verrouillage  de  generateur  et 
verrouillage  de  trame  a  l’aide  de  materiels  et  logiciels  innovateurs.  Cette  exigence  a  ete  verifiee  et 
validee  par  des  essais  detailles  et  une  commande  stricte  de  la  configuration. 

2.  Le  systeme  devait  etre  portable  et  occuper  peu  d’espace.  Une  conception  d’economie  d’espace  a  ete 
deflnie  pour  chaque  GI  afln  de  satisfaire  ces  exigences.  Ces  solutions  exigeaient  le  developpement  et  la 
mise  en  oeuvre  de  methodes  permettant  d’ adapter  les  composants  et  de  reduire  la  consommation 
d’energie,  le  bruit  et  la  chaleur. 
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3.  Le  systeme  GI  a  ete  congu  pour  pouvoir  communiquer  avec  d’autres  systemes  utilisant 
1’ architecture  ouverte  et  les  normes  associees.  A  cette  fin,  on  a  fait  appel  au  protocole  ouvert  CIGI 
(Common  Image  Generator  Interface),  a  des  composants  commerciaux  et  a  la  distribution  Linux 
Centos.  Le  systeme  GI  a  aussi  ete  congu  de  fagon  a  assurer  l’interface  avec  d’autres  reseaux  en  utilisant 
les  protocoles  de  simulation  interactive  repartie  (SIR)  et  d’ architecture  evoluee  (HLA). 

4.  Le  «  pavage  »  obligatoire  4  x  4  de  16  entrees  d’interface  videonumerique  (DVI)  pour  la 
construction  d’une  scene  entiere  par  le  systeme  d’affichage  au  moment  de  1’ execution  necessitait  le 
rendu  reparti  utilisant  des  techniques  de  reseautage  avance  dans  Linux,  y  compris  la  multidiffusion,  la 
synchronisation  hote-entree  et  une  configuration  de  nceuds  maitre-esclave.  Ces  techniques  sont 
presentees  ici  en  detail. 

5.  Les  exigences  en  matiere  de  cout  et  d’ exploitation  du  systeme  reclamaient  l’utilisation  de 
composants  generiques  commerciaux  facilement  remplagables,  y  compris  des  cartes  graphiques 
modernes  avec  processeurs  graphiques  (GPU)  evolues. 

On  developpe  actuellement  d’autres  ameliorations  pour  le  systeme  GI,  y  compris  des  esclaves  sans  disque 
avec  demarrage  a  partir  du  reseau,  un  serveur  de  sauvegarde  de  reseau  entierement  integre  et  une  version 
a  jour  du  systeme  d’ exploitation  (Centos  5).  Ces  ameliorations  permettent  une  reduction  de  18  a  3  du 
nombre  de  disques  durs  dans  la  grappe,  ce  qui  simplifie  la  configuration  et  la  sauvegarde  du  systeme,  tout 
en  reduisant  le  nombre  de  disques  durs  a  proteger  en  vue  de  l’utilisation  future  de  donnees  classifies. 

Array  a  developpe  et  deploy  e  pour  le  ADDNS  un  systeme  moderne  de  generateurs  d’ images  generiques 
evolutifs,  a  architecture  ouverte,  utilisant  des  composants  commerciaux.  Le  systeme  peut  facilement  etre 
mis  a  niveau  et  etendu  a  des  applications  plus  exigeantes,  comme  l’affichage  d’un  simulateur  de  vol  et  des 
projecteurs  laser  a  resolution  superieure.  Parmi  les  defis  a  relever  a  l’avenir,  il  faut  reduire  davantage  la 
latence  du  reseau  et  accroitre  la  resolution  des  cartes  graphiques  afin  de  supporter  les  projecteurs  laser  a 
haute  resolution  de  la  prochaine  generation. 
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Seuil  de  detection  du  deplacement  visuel  dans  un  simulateur 
de  vol  maille  en  reseau 


Christine  M.  Covas1*,  James  P.  Gaska**,  Lt  Megan  E.  Shamp*,  et  Byron  J.  Pierce* 


*Air  Force  Research  Laboratory 
**Link  Simulation  and  Training 
^ Papier  presente  (photographie  ci-dessous) 


Resume  :  Les  simulateurs  mailles  en  reseau  permettent  de  faciliter  l’entrainement  en  equipe  grace  a  la 
creation  d’environnements  d’exercice  et  de  simulations  qui  represented  des  operations  du  monde  reel. 
Cependant,  les  simulateurs  mailles  en  reseau  sont  souvent  touches  par  des  problemes  de  connectivity 
comme  le  delai  du  reseau  constant  et  variable.  Le  delai  du  reseau  peut  produire  des  differences  de  position 
ou  une  gigue  visuelle  dans  la  trajectoire  de  vol  d’un  modele  mobile  pouvant  avoir  une  incidence  sur  la 
perception  generale  des  pilotes  de  la  fidelite  du  mouvement.  On  peut  utiliser  des  algorithmes  de 
generation  d’image,  comme  le  lissage  de  position  de  modeles,  pour  reduire  les  effets  sur  la  visibility  du 
delai  du  reseau.  Cependant,  l’utilisation  du  lissage  peut  aussi  contribuer  a  l’erreur  dans  la  trajectoire  de 
mouvement  d’une  entite.  Dans  ces  travaux  de  recherche,  on  vise  a  determiner  le  seuil  de  detection  du 
deplacement  visuel  pour  une  tache  de  vol  typique,  le  vol  en  formation,  comme  fonction  d’une  distance 
simulee  (100,  200  et  400  metres)  et  du  lissage  (pas  de  lissage  ou  lissage  sur  1  seconde).  Les  resultats 
montrent  une  augmentation  importante  du  seuil  de  detection  avec  l’accroissement  de  la  distance.  L’ajout 
du  lissage  de  la  position  des  modeles  permet  aussi  d’accroitre  la  quantite  de  deplacement  visuel 
necessaire  pour  la  detection.  Enfln,  on  aborde  egalement  dans  ce  document  les  consequences  de  ces 
resultats,  ainsi  que  des  projets  de  recherche  a  venir  sur  le  delai  de  transport  du  reseau. 

Introduction  :  Pour  fournir  un  environnement  realiste  de  formation  au  travail  en  equipe,  on  utilise  des 
simulateurs  mailles  en  reseau  permettant  aux  stagiaires  d’effectuer  des  exercices  reproduisant  des 
conditions  qui  prevalent  dans  la  realite.  Lorsque  des  simulateurs  sont  mailles  en  reseau,  en  particulier  sur 
de  vastes  regions  geographiques,  les  interactions  entre  eux  deviennent  plus  complexes.  D’apres  lorsque 
Ton  procede  au  maillage  en  reseau  de  simulateurs,  on  doit  tenir  compte  de  trois  problemes  importants 
relies  au  realisme  temporel  [18].  Ces  problemes  concement  la  coherence  temporelle  du  monde  virtuel,  les 
delais  et  la  representation  globale  du  temps  dans  un  simulateur. 

Le  realisme  d’une  entite  faisant  partie  d’un  simulateur  maille  en  reseau  depend  de  facteurs  comme  le  delai 
du  reseau,  les  seuils  utilises  pour  determiner  quand  une  erreur  de  position  simulee  doit  etre  corrigee  ainsi 
que  les  algorithmes  utilises  pour  la  correction  de  ces  erreurs  de  position.  Ces  facteurs  peuvent  interagir  et 
produire  des  differences  de  position  entre  la  position  foumie  par  un  modele  local  d’une  entite  qui  est 
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utilise  pour  representer  cette  entite  et  la  position  reelle  de  cette  entite.  La  correction  de  differences  de 
position  par  l’utilisation  du  lissage  a  l’interieur  du  generateur  d’images  (GI)  se  traduit  par  une  variation  de 
position  de  l’entite  representee  [19].  Cette  experience  visait  a  evaluer  les  seuils  de  variation  en  fonction 
de  la  distance  du  cercle  oculaire  ainsi  que  le  lissage  de  position  effectue  par  le  GI.  Ces  donnees 
contribueront  a  un  paradigme  de  recherche  plus  important  pour  revaluation  de  l’impact  qu’ont  les 
parametres  de  reseau  sur  l’execution  des  taches  dans  un  environnement  de  simulation  de  vol. 

Methodes  :  On  a  fait  appel  a  cinq  observateurs  pour  evaluer  les  effets  qu’ont  la  distance  du  cercle 
oculaire  et  le  lissage  de  position  sur  le  seuil  de  detection  des  variations  de  position,  ou  la  gigue  provoquee 
par  le  delai  de  transport  du  reseau.  La  conception  de  cette  experience  englobait  deux  niveaux  de  lissage  de 
position  (aucun  lissage  et  lissage  d’une  seconde),  trois  distances  simulees  (100,  200  et  400  metres)  et 
treize  amplitudes  de  variation  (entre  0  et  8,192  metres)  pour  chaque  distance.  Nous  avons  utilise  une 
formule  de  mesures  repetees  pour  un  total  de  2  (lissages)  x  3  (distances)  x  13  (amplitudes  de  variation)  x 
5  (observateurs)  x  15  (repetitions). 

Les  stimuli  etaient  constitues  d’un  ciel  bleu  et  d’un  simulateur  tridimensionnel  realiste  representant  toute 
la  structure  d’un  F  16.  Les  scenes  visuelles  etaient  representees  au  moyen  d’une  application  de 
visualisation  en  temps  reel  de  MetaVR  qui  s’appelle  generateur  de  scenes  de  realite  virtuelle  [20]. Un 
logiciel  personnalise,  ecrit  en  C++,  etait  utilise  pour  le  controle  des  caracteristiques,  la  synchronisation  et 
le  sequencement  des  sequences  de  mouvement,  la  communication  avec  le  VRSG  ainsi  que  la  consignation 
des  reponses  de  l’observateur. 

Un  essai  consistait  en  une  presentation  du  F-16  d’une  duree  de  2  secondes  dans  une  scene  visuelle  fixe. 
L’arriere-plan  constitue  du  ciel  bleu  etait  present  pendant  toute  la  duree  de  chaque  bloc  d’essais.  Les 
distances  simulees  variaient  selon  les  blocs  d’essais.  Pour  chaque  bloc  d’essais  de  distance,  il  y  avait  une 
gamme  de  13  amplitudes  de  variation  differentes.  A  la  suite  de  chaque  presentation  de  l’appareil,  un  texte 
s’affichait  a  l’ecran  pour  demander  aux  observateurs  s’ils  avaient  decele  de  la  gigue  (Did  you  detect 
jitter?)  et  pour  leur  donner  le  choix  de  repondre  par  oui  ou  non  (Yes  or  No). 

Resultats  :  On  a  analyse  les  resultats  en  superposant  une  courbe  de  Weibull  aux  donnees  de  reponse 
moyennes  obtenues  aupres  de  chaque  observateur  pour  chaque  combinaison  de  lissage  et  de  distance,  afin 
d’obtenir  un  seuil  au  niveau  de  performance  de  63  %.  On  a  ensuite  converti  ces  donnees  en  angle  visuel, 
exprime  en  minutes  d’arc,  afin  d’ evaluer  si  les  observateurs  avaient  besoin  de  renseignements  visuels 
differents  pour  chaque  combinaison  de  conditions.  On  a  ensuite  soumis  les  donnees  brutes  relatives  aux 
distances  et  aux  angles  visuels  a  une  analyse  de  variance  (ANOVA)  des  mesures  repetees  visant  a  evaluer 
la  presence  de  tout  effet  ou  de  toute  interaction  entre  la  distance  et  le  lissage  de  position.  Pour  terminer, 
on  a  procede  a  des  tests  T  afin  de  determiner  s’il  y  avait  une  difference  de  seuil  de  detection  entre  les 
conditions  qui  prevalaient  lorsqu’il  n’y  avait  pas  de  lissage  de  position  et  lorsqu’il  y  avait  lissage  de 
position,  en  ce  qui  a  trait  aux  donnees  brutes  relatives  aux  distances  et  aux  angles  visuels. 

La  figure  1  illustre  les  seuils  de  detection,  en  metres,  pour  les  deux  conditions  de  lissage  en  fonction  des 
trois  conditions  relatives  a  la  distance.  D’apres  cette  figure,  pour  les  deux  conditions  de  lissage,  le  seuil  de 
detection  augmente  generalement  en  fonction  de  la  distance.  Cette  figure  indique  egalement  que  l’ajout  de 
lissage  augmente  aussi  les  seuils  de  detection.  Une  ANOVA  a  permis  d’etablir  que  l’effet  d’une  distance 
simulee  etait  statistiquement  important  F  (2,  8)  =  6,97,  p  <  0,05.  Une  comparaison  ulterieure  par  paire  a 
demontre  que  les  distances  simulees  suivantes  presentaient  des  differences  importantes  (p  <  0,05)  :  100  m 
par  rapport  a  200  m  et  100  m  par  rapport  a  400  m. 
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Figure  20.  Amplitudes  moyennes  de  seuil ,  en  metres,  pour  trois  distances  simulees  et  deux  conditions  de 
lissage.  Le  cercle  represente  la  condition  oil  il  ny  a  pas  de  lissage  et  le  carre,  la  condition  oil  il  y  a  un 
lissage  d’une  seconde.  Les  barres  d’erreur  represented  Ferreur  type  reelle  calculee. 

Nous  n’avons  decouvert  aucun  effet  global  important  du  lissage  ni  aucune  interaction  avec  la  distance  du 
cercle  oculaire.  La  figure  2  illustre  la  proportion  de  bonnes  reponses  sur  quinze  essais  pour  les  deux 
conditions  de  lissage  pour  lesquelles  on  a  calcule  la  moyenne  en  fonction  de  tous  les  sujets  et  de  toutes  les 
distances  simulees.  Comme  il  existe  une  difference  visuelle  dans  le  seuil  de  detection  global  entre  ces 
deux  conditions  de  lissage,  nous  voulions  egalement  verifier  l’hypothese  de  difference  nulle  selon 
laquelle  il  n’y  aurait  aucune  difference  entre  les  seuils  mesures  dans  la  condition  ou  il  n’y  a  pas  de  lissage 
et  ceux  mesures  dans  la  condition  ou  il  y  a  un  lissage  d’une  seconde,  en  utilisant  un  contraste  a  priori.  En 
procedant  a  un  test  T  bilateral,  nous  avons  decouvert  une  difference  importante  entre  les  seuils  mesures 
dans  la  condition  ou  il  n’y  a  pas  de  lissage  et  ceux  mesures  dans  la  condition  ou  il  y  a  un  lissage,  t  (13)  =  - 
2,26,  p  <  0,04. 
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Figure  21.  Proportion  de  bonnes  reponses  sur  quinze  essais  pour  les  deux  conditions  de  lissage 
pour  lesquelles  on  a  calcule  la  moyenne  en  fonction  de  tons  les  sujets  et  de  toutes  les  distances 
simulees  (chaque  point  represente  225  points  de  donnees).  Le  cercle  noir  represente  la  condition 
oil  il  ny  a  pas  de  lissage  et  le  cercle  blanc,  la  condition  oil  il  y  a  un  lissage  d’une  seconde. 

Pour  evaluer  l’effet  qu’ont  la  distance  et  le  lissage  de  position  sur  T angle  visuel  du  seuil  de 
detection,  nous  avons  effectue  une  ANOVA  des  mesures  repetees.  La  distance  et  le  lissage 
n’avaient  aucun  effet  important  ni  aucune  interaction  importante  sur  Tangle  visuel.  La  figure  3 
illustre  les  seuils  de  detection,  en  minutes  d’arc,  pour  les  deux  conditions  de  lissage  en  fonction 
des  trois  conditions  relatives  a  la  distance.  Cette  figure  indique  qu’une  augmentation  de  Tangle 
visuel  de  T  amplitude  de  variation  n’etait  pas  necessaire  a  la  detection,  puisque  la  distance  simulee 
a  augmente.  Elle  indique  cependant  que  Tajout  du  lissage  a  effectivement  provoque  une 
augmentation  de  Tangle  visuel  du  seuil  de  detection.  En  procedant  a  un  test  T  bilateral,  nous 
avons  decouvert  une  difference  importante  entre  Tangle  visuel  du  seuil  de  detection  mesure  dans 
la  condition  ou  il  n’y  avait  pas  de  lissage  et  celui  mesure  dans  la  condition  ou  il  y  avait  un  lissage, 
t  (13)  =  2,16,  p<  0,01. 
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Figure  22.  Amplitudes  moyennes  de  seuil,  en  minutes  d’arc,  pour  trois  distances  simulees  et  deux 
conditions  de  lissage.  Le  cercle  represente  la  condition  oil  il  ny  a  pas  de  lissage  et  le  carre,  la 
condition  ou  il  y  a  un  lissage  d’une  seconde.  Les  barres  d’erreur  represented  Verreur 

type  reelle  calculee. 

Discussion  :  Les  resultats  de  cette  experience  indiquent  qu’une  augmentation  de  la  distance 
simulee  provoque  une  augmentation  de  la  variation,  en  espace  de  simulation,  necessaire  a  la 
detection  du  mouvement  de  l’aeronef  cible.  Cependant,  lorsque  la  variation  etait  exprimee  en 
unites  d’angle  visuel,  l’effet  de  la  distance  simulee  n’etait  pas  important,  ce  qui  indique  que  les 
seuils  etaient  determines  par  la  variation  angulaire.  De  plus,  dans  les  conditions  utilisees  dans  le 
cadre  de  cette  etude,  le  lissage  double  presque  les  seuils  de  variation  angulaire. 

Dans  toutes  les  conditions,  les  seuils  de  variation  etaient  petits  -  environ  2  minutes  d’arc  pour  la 
condition  sans  lissage  et  4  minutes  d’arc  pour  la  condition  avec  lissage,  ce  qui  se  traduit  par  des 
seuils  de  variation  de  lA  et  1  pixel  pour  les  conditions  sans  lissage  et  avec  lissage,  respectivement. 
En  fait,  dans  le  cadre  d’etudes  effectuees  dans  des  conditions  optimales,  on  signale  des  seuils  de 
variation  de  2  secondes  d’arc  [21]. 

Il  n’est  pas  etonnant  de  constater  que  le  lissage,  qui  reduit  la  vitesse  de  la  cible,  a  provoque  une 
augmentation  du  seuil  de  variation.  Dans  un  environnement  maille  en  reseau,  on  utilise  le  lissage 
pour  reduire  la  pregnance  visuelle  de  la  variation  et  foumir  a  un  observateur  une  trajectoire  de  vol 
qui  a  l’air  plus  realiste.  Cependant,  la  trajectoire  de  vol  avec  lissage  fournira  une  representation 
moins  precise  de  la  trajectoire  de  vol  reelle  (Lin  et  autres,  1995).  La  sensibilite  elevee  du  systeme 
visuel  en  matiere  de  detection  de  la  variation  que  demontre  cette  etude  et  d’ autres  etudes  laisse 
croire  que  l’erreur  de  position  de  la  trajectoire  de  vol  avec  lissage  peut  etre  codee  par  le  systeme 
visuel  et  pourrait  done  provoquer  une  deterioration  des  performances.  De  plus,  comme  la 
trajectoire  de  vol  avec  lissage  a  l’air  realiste,  elle  peut  alterer  les  performances  d’un  pilote,  tandis 
que  le  passage  brusque  non  realiste  a  un  lissage  desactive  peut  facilement  etre  ignore  par  le  pilote. 
Les  benefices  et  les  avantages  du  lissage  laissent  done  toujours  place  a  la  discussion. 
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Comme  cela  a  ete  mentionne  anterieurement,  cette  experience  est  la  premiere  d’une  serie 
d’ experiences  consues  pour  determiner  l’effet  des  conditions  du  reseau  sur  les  taches  de  pilotage 
dans  un  environnement  d’entrainement  sur  simulateur  maille  en  reseau.  Au  Air  Force  Research 
Laboratory  de  Mesa  (Arizona),  nous  procedons  a  V evaluation  approfondie  des  differences  de 
position  physiques  reelles  qui  surviennent  en  fonction  de  la  charge  globale  du  reseau.  Cette 
evaluation  nous  permettra  de  comparer  nos  resultats  obtenus  lors  de  la  presente  experience  aux 
differences  de  position  reelles  provoquees  par  la  charge  du  reseau.  Nous  procedons  egalement  a 
une  autre  evaluation  consistant  a  evaluer  les  differents  types  de  differences  de  position 
provoquees  par  la  charge  que  constituent  les  paquets  du  reseau  sur  un  reseau  longue 
distance  (p.  ex.,  de  Mesa  (Arizona)  a  Melbourne  (Australie)). 
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9  Facteurs  humain 


9.1  Evaluation  de  la  definition  spatiale  et  temporelle  des 

projecteurs  numeriques  utilises  en  simulation  de  vol  plein 
champ 


James  P.  Gaska'*,  George  A.  Geri*,  Marc  D.  Winterbottom**  et  Byron  J.  Pierce** 


*Link  Simulation  and  Training ,  Mesa,  Arizona,  USA 
** Air  Force  Research  Laboratory,  Mesa,  Arizona,  USA 
^ Papier  presente  (photographic  ci-dessous) 


Introduction  :  Les  projecteurs  numeriques  bases  sur  les  technologies  des  cristaux  liquides  ou  des 
micromiroirs  offrent  une  definition  spatiale  superieure  a  celle  qu’offrent  les  tubes  cathodiques 
habituellement  utilises  dans  les  applications  des  simulateurs  de  vol.  Cependant,  leur  reponse 
temporelle  est  limitee  par  de  longues  durees  de  maintien.  La  duree  de  maintien  est  l’intervalle 
pendant  lequel  les  pixels  persistent  sur  chaque  image,  et  elle  est  liee  tant  a  la  conception  du  circuit 
pilote  qu?a  celle  de  l’ecran  lui-meme.  Des  durees  de  maintien  longues  se  traduisent  par  un  flou  des 
images  mobiles  pouvant  alterer  la  detection  et  1’ identification  des  cibles  simulees  ainsi  que  le 
realisme  des  scenes  simulees. 

On  presente  ici  les  resultats  d’une  evaluation  de  plusieurs  projecteurs  numeriques  mettant  en 
oeuvre  diverses  techniques  permettant  de  reduire  la  duree  de  maintien  des  pixels.  Cette  evaluation 
comportait  des  estimations  des  definitions  spatiale  et  temporelle,  ainsi  que  des  tests  de  perception 
utilises  pour  evaluer  la  validite  de  ces  estimations.  On  peut  utiliser  les  techniques  decrites  ici  pour 
evaluer  l’utilite  potentielle  des  projecteurs  envisages  pour  une  application  donnee  de  simulateur. 

Methodes  :  On  a  teste  les  projecteurs  suivants  :  des  ecrans  a  cristaux  liquides  ferroelectriques  sur 
silicium  (FLCoS),  des  ecrans  a  cristaux  liquides  sur  silicium  (LCoS),  des  ecrans  a  cristaux 
liquides  (LCD),  un  projecteur  numerique  (DLP)  (dispositif  numerique  a  micromiroirs)  et  un 
projecteur  a  tube  cathodique.  On  a  fait  varier  la  duree  de  maintien  des  FLCoS  et  des  projecteurs  a 
LCD  au  moyen  d’obturateurs  mecaniques,  et  celle  du  projecteur  DLP,  au  moyen  d’un  obturateur 
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electronique.  Comme  on  a  utilise  les  projecteurs  a  tube  cathodique  et  a  LCD  principalement  pour 
effectuer  des  comparaisons,  on  n’en  a  pas  fait  varier  les  durees  de  maintien. 


On  a  d’abord  determine  la  luminosite,  le  contraste  et  la  fonction  factorielle  de  chaque  ecran  en 
preparation  des  mesures  de  la  definition  spatiale,  de  la  reponse  temporelle  et  des  deux  definitions 
temporelles.  On  a  ajuste  la  luminosite  et  le  contraste  du  tube  cathodique  de  maniere  a  obtenir 
1’  image  la  plus  lumineuse  correspondant  a  une  saturation  nulle  de  la  fonction  factorielle  de 
l’ecran  (c.  a  d.,  la  fonction  reliant  la  luminance  au  niveau  de  gris  a  l’entree).  On  a  ensuite  mesure 
la  luminance  et  le  contraste  totaux  au  moyen  des  quatre  carreaux  centraux  d’un  motif  de  test  en 
echiquier  de  4  carreaux  sur  4  qui  recouvrait  1’ image  en  entier.  On  a  egalement  utilise  le  niveau 
optimal  de  luminance  determine  pour  le  tube  cathodique  pour  les  autres  ecrans. 

On  a  mesure  la  definition  spatiale  au  moyen  d’une  procedure  normalisee  qui  necessitait 
l’affichage  de  motifs  sous  forme  de  grilles  constitutes  de  lignes  horizontales  ou  verticales 
espacees  de  l’une  des  trois  fagons  suivantes  :  (1  allumee/1  eteinte,  2  allumees/2  eteintes  et  3 
allumees/3  eteintes).  On  a  ensuite  mesure  la  distribution  de  la  luminance  des  motifs  de  maniere 
orthogonale  par  rapport  aux  lignes  et  on  a  calcule  le  contraste  des  motifs.  On  a  ensuite  trace  une 
courbe  du  contraste  en  fonction  de  la  frequence  des  motifs  sous  forme  de  grilles,  et  on  a  utilise 
1’ interpolation  pour  determiner  le  nombre  efficace  de  lignes  correspondant  a  un  contraste  de  25 
%,  lequel  nombre,  une  fois  converti  en  distance  a  1’ ecran,  correspond  a  une  mesure  de  la 
definition  spatiale.  On  a  ensuite  obtenu  le  nombre  de  lignes  resolues  en  divisant  le  nombre  de 
pixels  du  projecteur  par  le  nombre  efficace  de  lignes. 

On  a  mesure  la  reponse  temporelle  des  ecrans  au  moyen  d'une  photodiode,  afin  de  mesurer  la 
distribution  lumineuse  temporelle  associee  a  un  petit  carre  de  test  clignotant  a  30  Hz.  On  a 
procede  a  des  evaluations  perceptuelles  de  la  definition  temporelle  des  ecrans  au  moyen  de  deux 
techniques.  La  premiere  consistait  en  un  test  de  flou  de  lignes  mobiles  au  cours  duquel  une  paire 
de  lignes  blanches  verticales,  chacune  de  la  largeur  d’un  pixel,  etait  deplacee  horizontalement  sur 
un  fond  sombre  a  differentes  vitesses.  Les  observateurs  reglaient  la  largeur  de  fespacement  entre 
les  lignes  d'essai  de  maniere  a  reduire  au  minimum  cet  espacement.  Cet  essai  etait  fonde  sur  le 
fait  qu'une  definition  temporelle  superieure  se  traduira  par  moins  de  flou  des  lignes  d'essai 
verticales  dans  le  sens  du  deplacement,  ce  qui  permettra  en  retour  aux  observateurs  de  voir  un 
espacement  de  plus  en  plus  petit  entre  les  lignes  verticales.  Ainsi,  la  largeur  reglee  de 
fespacement  peut  constituer  une  mesure  du  flou  de  fimage.  La  deuxieme  consistait  en  une  tache 
de  detection  des  mouvements  de  roulis  de  l’aeronef.  Le  concept  de  cette  tache  est  semblable  a 
celui  du  test  des  lignes  mobiles,  mais  il  foumit  une  estimation  du  flou  du  au  mouvement  pour  une 
tache  de  simulateur  de  vol  plus  realiste.  Dans  le  cadre  de  cette  tache,  des  modeles  reduits  d’avions 
a  reaction  se  deplagaient  lateralement  sur  un  fond  d’ ecran  et,  au  milieu  de  ce  dernier,  ils 
effectuaient  soit  un  roulis  de  0  degre  (pendant  la  moitie  des  essais),  soit  un  roulis  compris  entre  4 
et  23  degres  (pendant  l’autre  moitie  des  essais).  On  a  obtenu  les  seuils  de  detection  des 
mouvements  de  roulis  en  trouvant  le  degre  de  roulis  correspondant  a  des  detections  de  roulis 
exactes  a  82  %. 

Resultats  :  Le  nombre  de  lignes  resolues  pour  les  projecteurs  testes  variait  d’ environ  1  200,  dans 
le  cas  d’un  projecteur  a  tube  cathodique,  a  environ  4  000,  dans  le  cas  de  projecteurs  DLP  et 
LCoS.  Les  durees  de  maintien  des  projecteurs  variaient  de  moins  d’une  milliseconde,  dans  le  cas 
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du  projecteur  a  tube  cathodique,  a  environ  16,7  millisecondes  (p.  ex.,  image  video  complete), 
dans  le  cas  du  projecteur  a  LCD. 

Dans  le  cas  du  projecteur  a  tube  cathodique,  le  flou  pergu  mesure  dans  le  cadre  du  test  des  lignes 
mobiles  est  passe  d’ environ  5  a  12  minutes  d’arc,  alors  que  la  vitesse  de  la  cible  est  passee 
d’environ  5  a  68  degres/seconde.  Dans  le  cas  des  projecteurs  a  LCD,  a  LCoS  et  a  DLP 
testes  dont  les  durees  de  maintien  sont  superieures  a  10  millisecondes,  le  flou  pergu  est 
passe  de  5  a  10  minutes  d’arc,  dans  le  cas  de  vitesses  de  cibles  inferieures  a  10  degres/seconde,  a 
40  a  60  minutes  d’arc,  dans  le  cas  de  vitesses  de  cibles  superieures  a  environ  50  degres/seconde. 
Dans  le  cas  des  projecteurs  a  LCoS  et  a  DLP,  au  fur  et  a  mesure  que  la  duree  de  maintien 
diminuait,  le  flou  pergu  diminuait  egalement,  mais  cette  diminution  etait  generalement 
proportionnelle  a  la  vitesse  de  la  cible.  Dans  le  cas  des  projecteurs  a  LCoS  et  a  DLP,  le  flou  pergu 
n’etait  pas  tres  different  de  celui  d’un  projecteur  a  tube  cathodique  lorsque  l’on  a  reduit  la  duree 
de  maintien  jusqu’a  environ  quatre  a  six  millisecondes.  Les  seuils  de  detection  des  mouvements 
de  roulis  etaient  d’environ  10,  14  et  16  degres  dans  le  cas  de  vitesses  aeronefs  cibles  de  8,  17,5  et 
35  degres/seconde,  respectivement.  Ces  donnees  denotent  une  correlation  evidente  entre  les 
donnees  de  detection  des  mouvements  de  roulis  et  les  mesures  de  la  reponse  temporelle  ainsi  que 
les  donnees  du  test  des  lignes  mobiles. 

Implications  :  LAir  Force  et  la  Navy  des  Etats-Unis  envisagent  ou  sont  en  train  de  remplacer  les 
ecrans  a  tube  cathodique  par  des  ecrans  numeriques  dans  les  simulateurs  de  vol.  Toutefois,  une 
faible  definition  temporelle  et  le  flou  d'images  mobiles  connexe  constituent  un  probleme 
important  dans  futilisation  de  ces  ecrans  numeriques.  Les  techniques  devaluation  des  affichages 
mises  au  point  a  TAFRL,  a  Mesa,  offrent  un  moyen  relativement  simple  de  mesurer  objectivement 
les  definitions  spatiale  et  temporelle  et,  de  plus,  de  predire  leurs  consequences  sur  la  perception. 
Les  resultats  de  ces  evaluations  indiquent  que  pour  tous  les  types  de  projecteurs  testes,  une 
reduction  de  la  duree  de  maintien  jusqu’a  environ  quatre  a  six  millisecondes  reduit  de  fagon 
efficace  le  flou  d’une  image  mobile  jusqu’a  celui  d’un  projecteur  a  tube  cathodique,  lequel  flou 
correspond  actuellement  a  la  norme  acceptee  en  matiere  de  reponse  temporelle  de  projecteur. 
Pour  terminer,  il  a  ete  etabli  que  les  resultats  des  mesures  de  definition  temporelle 
correspondaient  au  rendement  dans  le  cadre  d’une  tache  air  air  representative  de  celles  executees 
sur  des  simulateurs  de  vol  complets.  Pour  evaluer  les  projecteurs  dans  les  reglages  appliques,  il 
faudra  elaborer  et  mettre  en  oeuvre  des  taches  analogues  pour  les  simulateurs  de  vol  vises. 
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9.2  Paradigme  de  cognition  spatiale  pour  (’evaluation  de 

I’influence  du  port  de  lunettes  de  vision  nocturne  sur  la 
performance  en  matiere  de  reperage 


Michelle  Gauthier*  et  Avi  Parash'  ** 

*CAE  Professional  Services ,  Ottawa 

**Carleton  University ,  Human  Oriented  Technology  Laboratory,  Ottawa 
^ Papier  presente  (photographic  ci-dessous) 


Les  LVN  (lunettes  de  vision  nocturne)  ameliorent  la  perception  visuelle  dans  des  conditions  de 
faible  lumiere  ou  d’obscurite;  toutefois,  a  cause  de  leurs  caracteristiques  optiques  et 
electrooptiques,  la  perception  visuelle  differe  de  celle  obtenue  dans  des  conditions  de  lumiere 
normale.  Par  consequent,  la  plupart  des  etudes  publiees  sur  1’ influence  du  port  de  LVN  sur  la 
performance  humaine  ont  ete  fondees  sur  des  recherches  dans  les  domaines  de  la  psychophysique 
et  de  la  perception  (Macuda,  et  autres,  2004;  Niall  et  autres,  1999).  Toutefois,  des  signalements 
anecdotiques  indiquent  que  le  port  de  LVN  influent  sur  T  orientation  spatiale  et  le  reperage  en 
exergant  un  effet  sur  les  fonctions  cognitives.  Quelques  etudes  ont  systematiquement  caracterise 
les  consequences  du  port  de  LVN  sur  la  congnition  en  general  et,  plus  particulierement  sur  le  plan 
du  comportement  spatial. 

Le  but  du  present  article  est  d’exposer  une  methode  empirique  pour  T  etude  de  Tinfluence  du  port 
de  lunettes  de  vision  nocturnes  (LVN)  sur  le  reperage  et  la  performance  en  matiere  d’ orientation, 
qui  introduit  un  paradigme  de  la  recherche  en  cognition  spatiale.  Ce  paradigme  est  fonde  sur  deux 
etapes  principales  :  1)  Tapprentissage  et  Texecution  d’exercices  et  2)  1’evaluation  des 
connaissances  spatiales  acquises.  A  la  premiere  etape,  les  participants  ont  decouvert  un 
environnement  par  la  navigation  et  le  reperage  actifs,  en  recherchant  des  cibles  a  Tinterieur  d’un 
labyrinthe  grandeur  nature  avec  et  sans  LVN.  A  la  seconde  etape,  la  connaissance  de 
T  environnement  a  ete  evaluee  au  moyen  de  deux  tests  de  memoire  spatiale  (une  tache 
d’ appreciation  de  la  direction  relative  et  une  tache  de  dessin  de  carte).  II  est  propose  d’utiliser  ce 
type  de  methode  pour  etudier  les  aspects  perceptuels  et  cognitifs  inherents  a  Tutilisation  de 
dispositifs  d’ amelioration  de  la  vision  portes  sur  la  tete,  en  particulier  dans  des  taches  de 
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recherche  et  de  reperage.  En  outre,  cette  methode  peut  etre  utilisee  pour  l’essai  comparatif  et 
l’essai  d’acceptation  des  nouvelles  technologies  d’ amelioration  de  la  vision. 

Enfin,  la  methode  employee  dans  cette  etude  peut  servir  a  Elaboration  et  a  1’evaluation  de  lignes 
directrices  et  de  strategies  en  matiere  de  formation,  plus  en  accord  avec  les  processus  de  cognition 
spatiale  humaine.  Certaines  repercussions  d’ordre  pratique,  interessant  la  formation  sur 
l’utilisation  des  LVN  et  la  recherche  eventuelle  sur  le  terrain,  sont  examinees,  et  ce,  afin 
d’explorer  les  ameliorations  possibles  sur  le  plan  de  la  conception  et  de  l’utilisation  de  ces 
dispositifs. 

Les  resultats  de  cette  etude  ont  indique  que  la  navigation  et  le  reperage  semblaient  etre  plus 
difficiles  avec  des  LVN,  les  temps  de  navigation  etant  plus  longs  et  les  virages  inutiles  plus 
nombreux  comparativement  a  l’execution  de  ces  memes  taches  sans  LVN.  De  plus,  au  cours 
d’essais  de  reperage  menes  avec  le  groupe  experimental,  on  a  observe  une 
diminutionconsiderable  et  rapide  des  temps  de  navigation  et  une  reduction  des  etapes  de 
navigation  par  rapport  au  groupe  temoin.  Dans  une  tache  d’ appreciation  de  l’orientation  relative, 
le  positionnement  relatif  a  des  objets  recherches  et  a  des  distracteurs  se  trouvant  dans  une  meme 
piece  etait  plus  juste  avec  le  groupe  qui  n’utilisait  pas  de  LVG.  Dans  une  tache  de  dessin  de  carte, 
les  membres  du  groupe  portant  des  LVN  avaient  plus  tendance  a  positionner  incorrectement  des 
objets  et  ont  obtenu  les  pires  resultats. 

Ces  resultats  demontrent  clairement  que  les  LVN  influent  sur  la  performance  en  navigation 
spatiale  et  en  reperage  ainsi  que  sur  l’acquisition  de  connaissances  spatiales.  En  caracterisant 
objectivement  1’ influence  des  LVN  sur  le  reperage  et  1’ orientation  spatiale,  les  resultats  actuels 
foumissent  une  preuve  empirique  qui  vient  s’ajouter  aux  signalements  anecdotiques.  De  plus,  ces 
resultats  peuvent  constituer  une  demonstration  empirique  de  l’efficacite  de  ce  paradigme. 
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9.3  Psychophysique  de  (’observation  de  halos  dans  les  LVN 


Robert  S.  Allison1*,  Tracey  Brandwood*,  Margarita  Vinnikov*,  Janies  E.  Zacher*,  Sion 
Jennings**,  Todd  Macuda**,  Paul  Thomas***,  et  Stephen  A.  Palmisano**** 

* Centre  for  Vision  Research ,  York  University ,  Toronto 
**Institute  for  Aerospace  Research,  National  Research  Council  of  Canada,  Ottawa 

***Topaz  Technologies,  Toronto 

****School  of  Psychology,  University  of  Wollongong,  Wollongong,  Australia 
t Papier  presente  (photographic  ci-dessous) 


Aper^u  et  but  :  Effectuer  des  mesures  quantitatives  des  halos  autour  des  sources  lumineuses 
per^us  par  les  dispositifs  de  vision  de  nuit  (DVN)  selon  l’intensite  et  la  distance,  decrire  une 
methode  visant  a  simuler  leurs  effets  en  laboratoire  et  presenter  les  resultats  des  experiences 
psychophysiques  ayant  pour  but  d’analyser  les  erreurs  induites  par  les  halos  dans  l’estimation  de 
la  pente. 

Contexte  :  Simuler  avec  precision  la  physique  des  intensificateurs  d’ images  et  modeliser  les 
scenes  observees  a  l’aide  des  DVN  est  difficile  et  exige  beaucoup  de  calculs,  or  il  faut  realiser  ces 
activites  en  temps  reel  avec  une  frequence  d’ images  et  une  resolution  elevees  dans  des 
simulateurs  militaires  de  pointe.  Etant  donne  les  limites  inherentes  a  la  simulation  en  temps  reel, 
il  est  important  de  comprendre  les  incidences  des  artefacts  des  DVN  sur  l’execution  des  taches 
afin  de  prendre  des  decisions  rationnelles  techniques  sur  le  niveau  de  fidelite  requis.  La 
presence  d’un  halo  ayant  la  forme  d’un  disque  autour  des  sources  lumineuses  est  un  artefact 
propre  aux  DVN. 

Mesures  du  halo  :  Une  source  lumineuse  et  un  banc  optique  ont  ete  congus  sur  mesure  pour  creer 
des  stimuli  d’intensite  variable  observables  par  le  DVN  a  des  distances  diverses.  Pour  chaque  cas, 
trois  mesures  ont  ete  effectuees.  Deux  des  mesures  etaient  subjectives  et  visaient  a  mesurer  la 
grandeur  angulaire  apparente  du  halo,  et  la  troisieme  etait  une  mesure  objective  effectuee  a  l’aide 
d’une  camera  numerique.  Toutes  les  mesures  ont  ete  l’objet  d’un  interetalonnage  les  unes  avec  les 
autres  ainsi  qu’avec  des  cibles  etalons,  a  des  distances  connues,  afin  d’obtenir  des  donnees 
equivalentes  de  1’ angle  visuel  au  DVN. 
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Lorsqu’une  source  lumineuse  est  suffisamment  intense  pour  produire  un  halo,  alors  la  grandeur 
(mais  pas  l’intensite  ni  la  transparence)  de  ce  halo  sera  constante  pour  une  distance  et  une 
intensite  donnees  -  a  tout  le  moins  jusqu’a  ce  que  des  halos  secondaires  soient  observables.  Tout 
changement  dans  la  taille  apparente  est  faible  comparativement  aux  effets  plus  importants  de  la 
disparition  du  halo  ou  de  Tapparition  d’un  halo  double  a  mesure  que  l’intensite  de  la  source 
diminue  ou  augmente,  respectivement. 

Halos  consideres  comme  stimuli  visuels  :  Le  fait  que  la  grandeur  angulaire  des  halos  primaires 
ne  change  pas  en  fonction  de  la  distance  separant  le  DVN  de  la  source  lumineuse  entraine 
cependant  des  problemes  relatifs  a  la  perception.  Le  halo  devrait  se  rapetisser  a  mesure  que  Ton 
s’approche  de  la  source  lumineuse,  et  un  halo  brillant  et  distinct  devrait  sembler  plus  proche 
qu’un  halo  plus  intense,  meme  si  ce  dernier  est  plus  loin.  Nous  avons  verifle  ces  hypotheses  au 
laboratoire.  Nous  examinerons  la  maniere  dont  les  halos  peuvent  agir  comme  stimuli  visuels  et 
influencer  la  perception  des  objets  et  des  scenes  visuelles  plus  complexes. 

Milieu  simule  :  A  l’aide  de  modeles  physiques  du  fonctionnement  du  DVN,  une  simulation 
graphique  par  ordinateur  en  trois  dimensions  du  terrain  modelise  a  ete  realisee  sur  une  grappe 
d’ordinateurs  personnels.  Les  scenes  ont  ete  modelisees  a  l’aide  du  logiciel  3D  Studio  Max  a 
partir  de  cartes  numeriques  du  terrain.  Nous  utilisons  un  environnement  virtuel  API  (VE  2.2)  mis 
au  point  a  l’interne  pour  controler  et  configurer  la  simulation,  l’affichage  et  les  dispositifs 
d’entree.  La  simulation  est  principalement  visuelle  et  la  dynamique  des  aeronefs  n’est  pas 
modelisee.  On  a  eu  abondamment  recours  a  des  techniques  d’ombrage  de  pointe  pour  modeliser 
les  effets  des  halos  observes  par  le  DVN  en  temps  reel.  Les  experiences  ont  ete  realisees  dans  un 
milieu  d’immersion  virtuel  stereoscopique  de  grand  format. 

Experiences  psychophysiques  simulant  l’approche  d’un  helicoptere  :  Dans  l’une  des  series 
d’ experiences,  les  participants  ont  evalue  leur  orientation  par  rapport  au  sol.  Durant  la  simulation, 
les  participants  ont  regu  l’instruction  d’estimer  la  pente  du  sol  par  rapport  a  la  camera  virtuelle. 
Suite  au  stimulus,  une  scene  a  reperes  complets  dans  des  conditions  diumes  a  ete  afflchee  avec  un 
angle  d’inclinaison  aleatoire.  Les  participants  pouvaient  choisir  l’angle  d’attaque  de  la  camera 
virtuelle  et  on  leur  a  demande  de  faire  correspondre  P  orientation  de  la  camera  virtuelle  avec  leur 
estimation.  Le  reglage  de  la  correspondance  etait  enregistre  et  l’essai  suivant  commengait. 

Dans  une  autre  serie  d’ experiences,  les  participants  surveillaient  l’approche  simulee  d’un  aeronef 
vers  une  piste  d’atterrissage  et  estimaient  le  point  d’arrivee  au  sol  en  se  basant  sur  leur  cap.  Apres 
qu’ils  aient  visualise  la  sequence  d’approche,  on  arretait  l’approche  simulee  et  les  participants  on 
demandait  aux  participants  de  deplacer  un  marqueur  visuel  pour  etablir  un  alignement  avec  le 
point  d’arrivee  au  sol  estime. 

Lorsque  les  reperes  indiquaient  de  fagon  evidente  que  la  scene  observee  etait  inclinee,  les 
participants  ont  pergu  une  pente  proche  de  celle  que  l’on  trouvait  en  l’absence  de  halo,  tel  que 
prevu.  L’agencement  regulier  des  lumieres  a  permis  d’obtenir  differentes  perspectives  de 
profondeur,  y  compris  la  perspective  lineaire,  les  grandients  de  texture,  la  compression  (et  l’effet 
de  rapprochement)  et  la  possibility  d’inferer  un  horizon  implicite.  Lorsque  des  halos  sont  presents 
dans  une  scene  et  qu’ils  sont  associes  a  une  surface  inclinee,  leur  grandeur  varie,  dans  une 
certaine  mesure,  avec  la  distance  apparente  (constance  de  la  grandeur).  II  n’y  a  que  peu  de  conflit 
dans  ce  cas  particulier,  etant  donne  que  les  reperes  de  pente  dominent  et  que  l’invariance  du  halo 
est  pergue  comme  un  gradient  de  taille. 


74 


DRDC  Toronto  TR  2009-121 


Nous  examinerons  les  resultats  de  la  simulation  NVG  et  la  capacite  de  Putilisateur  a  compenser 
les  distorsions  liees  a  la  perception. 
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9.4  Effets  de  la  variation  de  resolution  d’ecran  et  de  vitesse 
d’entramement  sur  une  tache  de  pilotage  simulee4 


D.  C.  Donderi'*,  Keith  Niall**,  Karyn  Fish*  et  Benjamin  Goldstein* 
*Human  Factors  North  Inc 

**  Recherche  et  developpement pour  la  defense  Canada-Toronto 
^ Papier  presente  (photographie  ci-dessous) 


Resume  :  Deux  experiences  ont  servi  a  verifier  104  observateurs  dans  le  cadre  d’une  tache  de 
On  a  forme  104  observateurs  dans  le  cadre  d’une  tache  de  pilotage  simulee  au  moyen  d'un  PC, 
afin  de  mesurer  l’effet  produit  sur  les  performances  apres  l’entrainement  par  deux  variables  de 
simulation  de  vol :  la  resolution  d’ecran  et  la  vitesse  d’entrainement  simulee.  Une  manette  des  gaz 
et  un  manche  a  balai  servaient  a  commander  la  vitesse,  le  rayon  et  Tangle  d’inclinaison  d’un  F-18 
de  poursuite  decrivant  des  cercles.  La  tache  de  pilotage  consistait  a  rattraper  et  a  intercepter  un 
F-18  cible  decrivant  des  cercles  de  rayon  et  d’inclinaison  differents.  Cette  simulation  incluait  un 
poste  de  pilotage  realiste  du  F-18  de  poursuite,  un  F-18  cible  realiste,  un  relief  structure,  un 
horizon,  des  nuages  et  le  soleil.  Les  variables  d’interet  etaient  la  resolution  d’ecran  (768  x  1  024, 
960  x  1  280,  1  200  x  1  600  [reference])  ainsi  que  les  vitesses  d'entrainement  simulees  de  450, 
900  (reference)  ou  1  350  noeuds.  On  a  procede  a  Texperience  un  au  cours  d’une  seule  seance,  a  la 
resolution  de  reference,  avec  50  observateurs.  L’experience  un  comportait  un  pre-test  a  la  vitesse 
de  reference  et  une  seance  d’entrainement  qui  comportait  soit  18essais  d’entrainement  a 
900  noeuds  ou  a  1  350  noeuds,  neuf  essais  d’entrainement  a  450  et  a  900  noeuds  ou  six  essais 
d’entrainement  a  450,  900  et  1  350  noeuds  destines  a  differents  groupes  d’observateurs. 
L’entrainement  a  une  vitesse  constante  superieure  (1  350  noeuds)  a  la  vitesse  de  reference  a  donne 
lieu  aux  erreurs  d’entrainement  les  plus  importantes  et  aux  meilleures  performances  (vitesses  de 
reference)  apres  entrainement.  Dans  le  cadre  de  Texperience  deux,  laquelle  portait  sur 
54  observateurs,  on  a  utilise  la  meme  tache.  On  a  fait  varier  les  trois  resolutions  d'ecran  d’un 
observateur  a  l’autre,  tout  en  faisant  varier  les  vitesses  d'entrainement  au  sein  des  observateurs 


4  Ces  travaux  ont  ete  accomplis  en  vertu  d’un  contrat  passe  entre  Human  Factors  North  Inc  et  Recherche  et 
developpement  pour  la  defense  Canada  (RDDC).  Nous  tenons  a  remercier  Josie  Caro  d’ avoir  effectue  des  etudes 
pilotes  indispensables  qui  ont  facilite  les  travaux  mentionnes  ici.  Le  logiciel  necessaire  a  cette  simulation  a  ete 
developpe  par  la  fume  Array  Systems  Computing  Inc.  en  vertu  d’un  contrat  passe  avec  RDDC. 
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dans  le  cadre  de  trois  seances  qui  se  sont  echelonnees  sur  trois  jours.  Le  premier  jour,  on  a 
procede  a  la  familiarisation  et  au  pre-test  de  reference.  Une  seule  seance  d’entrainement  et  un  seul 
post-test  de  reference  ont  ete  effectues  au  cours  de  chacun  des  jours  deux  et  trois.  On  a  utilise 
toutes  les  permutations  des  paires  de  vitesses  a  450,  900  et  1  350  noeuds  pendant  les  seances  de 
formation  au  cours  des  jours  deux  et  trois.  Apres  la  premiere  seance  d’entrainement, 
l’entrainement  a  1  350  noeuds  a  resolution  elevee  (reference)  et  moyenne  a  donne  lieu  aux 
meilleures  performances  apres  entrainement.  Apres  les  deux  seances  d’entrainement,  on  a  obtenu 
les  meilleures  performances  dans  le  cadre  de  post-tests  a  la  suite  de  l’entrainement  a  resolution 
elevee  a  la  vitesse  d’entrainement  rapide  (1  350  noeuds),  dans  le  cadre  des  deux  seances 
d’entrainement.  A  faible  resolution,  les  performances  etaient  bien  pires  que  dans  le  cadre  d’un 
entrainement  a  resolution  elevee  (reference)  ou  moyenne.  Ces  resultats  remettent  l’accent  sur 
l’importance  de  la  resolution  d’ecran  dans  le  cadre  de  l’entrainement  sur  simulateur,  et  ils 
soutiennent  des  constatations  anterieures  selon  lesquelles  un  entrainement  a  une  vitesse 
superieure  a  la  vitesse  reelle  ameliore  les  performances  dans  le  cadre  d’une  tache  de  pilotage 
simulee  effectuee  a  une  vitesse  reelle  (reference)  de  post-tests. 
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10  Photogrammetrie 


10.1  Indexation  d’images  video  d’apres  des  images  de 
reference 


Vitaly  Zholudev'  *  et  Richard  Wildes** 

* Department  of  Computer  Science  and  Engineering,  York  University,  Toronto 
**Centre  for  Vision  Research,  York  University,  Toronto 
^ Papier  presente  (photographic  ci-dessous) 


Introduction  :  Les  travaux  portent  sur  le  reperage  de  donnees  dans  des  bases  de  donnees 
geospatiales,  particulierement  sur  la  superposition  d’images  acquises  par  differents  capteurs 
presentant  differents  points  de  vue  d’une  meme  scene.  La  recherche  offre  de  nombreuses 
applications  pour  la  creation  et  factualisation  des  cartes,  ainsi  que  pour  les  leves  et  autres  sources 
de  donnees  geospatiales.  Bien  que  d’importants  travaux  aient  ete  effectues  dans  le  domaine  de  la 
superposition  d’images  [23],  les  methodes  actuelles  sont  inoperantes  lorsque  les  differences  entre 
des  points  de  vue  ou  des  capteurs  sont  plus  que  mineures.  En  outre,  la  technologie  existante  de 
superposition  d’images  ne  permet  l’alignement  d’images  video  et  d’images  de  reference  qu’avec 
un  prealignement  a  quelques  centaines  de  pixels  pres  de  la  correspondance  exacte  [27].  II  est 
significatif  qu’en  raison  d’erreurs,  d’omissions  et  de  la  disponibilite  limitee  de  mesures  de 
telemetrie,  une  connaissance  a  priori  inadequate  de  l’alignement  d’images  video  et  d’images  de 
reference  constitue  un  probleme  concret. 

La  methode  mise  au  point  permet  1’ indexation  directe  de  descripteurs  d’images  video  dans  une 
base  de  donnees  d’images  de  reference.  La  reussite  de  findexation  entraine  que  la  position 
approximative  de  fimage  video  par  rapport  a  fimage  de  reference  a  ete  recuperee;  cette 
information  peut  ensuite  servir  a  prealigner  les  images  video  aux  images  de  reference  pour  les 
superposer  avec  les  outils  technologiques.  La  methode  offre  une  representation  uniforme  des 
images  video  et  des  images  de  reference  ainsi  qu’une  methode  permettant  de  quantifier  le  degre 
de  correspondance  entre  les  deux  echantillons  d’images.  La  representation  combine  l’apparence 
des  images,  caracterisee  par  des  regions  deflnies  selon  leur  texture,  et  la  geometrie  des  images, 
caracterisee  par  les  relations  spatiales  entre  les  regions  texturees.  De  par  sa  conception,  la 
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methode  de  mise  en  correspondance  est  robuste  pour  toute  une  gamme  de  distorsions 
photometriques  et  deformations  geometriques  entre  les  images,  notamment  les  variations  de 
contraste  des  tons  de  gris  et  les  transformations  geometriques  affines.  La  methode  elaboree  est 
definie  par  des  algorithmes  sur  lesquels  est  base  un  logiciel.  Des  evaluations  empiriques,  utilisant 
une  base  de  donnees  d’images  de  reference  formee  d’orthoimages  d’ emplacements  geographiques 
distincts,  indexees  par  des  images  video  aeriennes  synthetiques,  ont  permis  de  documenter  le 
potentiel  de  la  methode. 

Approche  technique  :  L’approche  en  matiere  d’indexation  d’images  video  d’apres  des  images 
de  reference  fait  intervenir  une  integration  innovatrice  de  descripteurs  regionaux  d’apparence  aux 
relations  geometriques  entre  les  regions.  Les  recherches  anterieures  sur  l’indexation  des  images 
tendaient  a  se  concentrer  uniquement  sur  l’apparence  ou  sur  la  geometrie  [26].  L’approche 
proposee  repose  sur  le  principe  que  la  combinaison  de  ces  deux  sources  d’ information  produit  une 
methode  plus  discriminative  que  l’utilisation  d’une  seule  de  ces  sources.  L’apparence  des  images 
est  caracterisee  a  faide  de  descripteurs  de  texture.  La  texture  est  utilisee  puisqu'elle  est  evidente 
sur  toute  source  d’imagerie  (a  la  difference  de  la  couleur  qui  depend  de  la  saisie  de  multiples 
bandes  spectrales).  Les  relations  geometriques  sont  deflnies  par  un  invariant  affin  qui  offre  la 
robustesse  necessaire  pour  une  gamme  de  variations  prevues  lorsqu’on  fait  coincider  les  images 
visees  :  les  images  video  aeriennes  et  les  images  de  reference. 

Apparence  :  Lorsqu’elle  est  observee  dans  le  champ  de  toute  image  individuelle  d’une  sequence 
video,  l’apparence  peut  etre  ambigue  en  raison  de  l’absence  de  contexte.  Par  exemple,  un  cliche 
presentant  un  couvert  forestier  uniforme  sur  toute  sa  surface  serait  difficile  a  distinguer  d’un  autre 
cliche  du  couvert  forestier.  Devant  un  tel  probleme,  la  solution  proposee  ecarte  l’observation 
isolee  de  cliches  video  individuels,  mais  repose  plutot  sur  la  creation  d’une  mosaique  de 
collections  de  cliches  d’une  video,  pour  former  une  image  plus  grande,  qui  servira  ensuite  de  base 
pour  l’indexation  ulterieure  d’apres  des  images  de  reference.  Dans  le  systeme  actuel,  un  outil 
logiciel  disponible  dans  le  commerce,  qui  permet  la  creation  de  mosaiques  d’images,  est  utilise 
pour  executer  le  traitement  necessaire.  [22]. 

Pour  creer  les  descripteurs  d’apparence  lies  a  la  texture,  des  methodes  normalisees  de  vision 
artificielle  sont  utilisees  pour  definir  la  structure  des  images  sous  forme  statistique  de  l’energie,  a 
des  echelles  et  des  orientations  multiples.  Pour  une  region  d’interet  donnee  notamment,  les 
donnees  d’images  sont  filtrees  a  faide  d’une  paire  de  filtres  passe-bande  en  quadrature,  regies  pour 
des  echelles  et  des  orientations  multiples.  Les  images  derivees  sont  redressees  point  par  point, 
puis  combinees  en  quadrature.  Finalement,  chaque  image  est  normalisee  en  divisant  chaque  point 
par  la  somme  de  toutes  les  valeurs  des  images  redressees  du  meme  point.  Cette  procedure  de 
normalisation  assure  l’invariance  des  contrastes  locaux  de  l'image,  puisque  fenergie  locale  dans 
chaque  bande  est  exprimee  en  pourcentage  de  fenergie  totale  dans  toutes  les  bandes.  Comme 
resultat,  on  obtient  un  ensemble  d'images  d’energie  normalisees  qui  analysent  les  donnees 
d’images  initiales  selon  une  echelle  et  une  orientation,  avec  robustesse  relativement  aux 
particularites  de  la  photometrie  locale  des  images.  Dans  la  forme  actuelle  du  logiciel,  quatre 
orientations  et  quatre  echelles  sont  utilisees  pour  le  filtrage. 

Les  images  d’energie  obtenues  saisissent  l’apparence  locale  des  images,  foumissant  notamment 
une  caracterisation  point  par  point.  Etant  donne  que  la  texture  d’une  image  est  une  caracteristique 
regionale,  les  mesures  en  chacun  des  points  sont  groupees  de  fagon  a  realiser  une  segmentation 
spatiale  des  images  et  constituer  des  regions  de  texture  uniforme.  Pour  effectuer  ce  groupement 
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de  donnees,  on  a  modifie  une  methode  existante  [24].  Cette  methode  s’appuie  sur  des  regions 
groupees,  de  sorte  que  la  variation  a  Tinterieur  d’un  groupe  est  relativement  faible  par  rapport  a  la 
variation  entre  les  groupes.  Alors  que  la  methode  initiale  utilisait  simplement  des  images  dans  des 
tons  de  gris  et  les  differences  d’intensite  pour  calculer  la  variation,  la  methode  actuelle  est  fondee 
sur  des  images  d’energie  derivees  et  le  produit  scalaire  pour  le  calcul  de  la  variation.  Ces 
modifications  ont  ete  apportees  pour  tenir  compte  des  descripteurs  d’apparence  lies  a  la  texture. 

Etant  donne  la  segmentation  recuperee  pour  une  region,  reformation  des  images  d’energie  est 
accumulee  pour  chaque  region  en  calculant  la  reponse  moyenne  dans  chaque  bande.  Un  vecteur  a 
seize  dimensions  (4  echelles  x  4  orientations)  qui  reproduit  fapparence  de  la  region  est  ainsi 
obtenu.  La  meme  representation  est  utilisee  pour  caracteriser  l’apparence  des  images  de  regions 
dans  une  video  et  des  orthoimages  de  reference. 

Telle  que  definie  jusqu’ici,  la  representation  de  Tapparence  est  sensible  a  la  rotation  :  les  textures 
orientees  paraissent  differentes  selon  les  rotations  dans  le  plan.  La  robustesse  par  rapport  a  la 
rotation  entre  les  echantillons  et  les  images  de  la  base  de  donnees  est  importante  :  elle  decoule  de 
Tangle  de  visee  propre  a  chaque  plateforme  de  capteurs.  La  solution  a  ce  probleme  repose  sur  le 
caractere  cyclique  de  la  rotation;  par  exemple  la  rotation  d'une  image  sur  360°  ne  produit  aucun 
changement.  L’ exploitation  de  cette  caracteristique  permet  d’obtenir  une  representation  robuste 
par  rapport  a  la  rotation  en  alignant  deux  representations  dans  Tespace  de  rotation.  Plus 
particulierement,  pour  la  comparaison  de  deux  vecteurs  de  texture,  une  rotation  est 
systematiquement  effectuee  sur  Tun  par  rapport  a  Tautre,  et  pour  chaque  orientation  relative  le 
produit  scalaire  est  calcule.  La  rotation  fournissant  le  produit  scalaire  le  plus  eleve  est  utilisee 
comme  transformation  de  Talignement. 

L’  invariance  par  rapport  a  Techelle  souleve  un  autre  probleme  important :  les  textures  multi- 
echelles  semblent  differentes,  a  differentes  resolutions  spatiales.  La  demarche  utilisee  face  a  cette 
invariance  est  similaire  a  Tapproche  proposee  pour  Tinvariance  de  rotation,  hormis  le  fait  que 
Techelle  n’est  pas  cyclique,  puisqu’un  changement  d’echelle  systematique  ne  permet  jamais  de 
retourner  a  Techelle  de  depart.  Pourtant,  on  peut  fonder  une  approche  sur  la  notion  que  des 
correspondances  peuvent  resulter  d’une  mise  a  Techelle.  Plus  particulierement,  si  deux  vecteurs 
de  texture  doivent  etre  compares,  Tun  est  systematiquement  mis  a  Techelle  par  rapport  a  Tautre, 
puis  le  produit  scalaire  est  calcule.  La  mise  a  Techelle  fournissant  le  produit  scalaire  le  plus  eleve 
est  utilisee  comme  transformation  de  Talignement. 

Geometrie  :  Afin  de  saisir  les  relations  geometriques  entre  des  zones  de  texture,  un  invariant 
affin  est  utilise.  De  fagon  analytique,  les  transformations  affines  decrivent  le  mouvement  d'un 
plan  soumis  a  une  projection  orthographique.  En  pratique,  les  transformations  affines  d'une  image 
ont  ete  largement  utilisees  en  vision  artificielle  pour  compenser  les  changements  de  points  de  vue 
dans  des  cas  ou  le  relief  d'un  objet  est  faible  par  rapport  a  la  distance  d'observation,  ce  modele 
etant  particulierement  populaire  pour  Tanalyse  d'images  aeriennes. 

Dans  le  cas  actuel,  il  est  possible  de  formaliser  le  probleme  comme  un  ensemble  de  quatre  regions 
d'images  et  leur  centroide.  Trois  des  centroides  de  regions  servent  a  etablir  une  base  a  deux 
dimensions;  les  coordonnees  du  quatrieme  centroide  sont  projetees  sur  la  base  pour  creer  une 
invariance  affine.  II  faut  remarquer  qu’etant  donne  un  ensemble  de  base  defini  d’apres  trois 
regions,  il  est  possible  de  representer  un  nombre  arbitrage  de  regions  additionnelles  en  fonction 
de  Tensemble  de  base  etabli.  Dans  le  cadre  des  travaux  actuels,  Tutilisation  d’une  seule  region 
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supplemental  permet  d’etudier  la  capacite  de  discrimination  d’un  petit  ensemble  de  regions; 
ainsi,  la  geometrie  relative  des  quatre  zones  est  saisie  par  la  paire  de  nombres  a  et  b. 

En  travaillant  avec  un  ensemble  de  quatre  regions  d'images,  on  dispose  de  douze  fagons  de 
decrire  un  ensemble  de  base  permettant  d'etablir  les  coordonnees  de  rinvariant  affin  de  la  region 
restante  (soit  douze  fagons  de  choisir  trois  elements  distincts  dans  un  ensemble  de  quatre).  Pour 
faire  suite  a  des  travaux  anterieurs  [25],  on  assemble  une  base  de  donnees  d’images  de  reference 
en  assurant  sa  redondance,  de  telle  fagon  que,  pour  chacun  des  modeles  (c’est-a-dire  une  image  de 
reference  representee  par  quatre  zones  de  texture),  on  cree  douze  entrees  dans  la  base  de  donnees, 
soit  une  entree  pour  chaque  choix  de  points  de  base.  Par  la  suite,  pour  un  echantillon  d’image 
video  caracterise  par  quatre  zones  de  texture,  trois  zones  peuvent  etre  choisies  indifferemment 
pour  deflnir  la  base  pour  la  paire  {a,  b )  qui  sera  comparee  a  la  base  de  donnees  :  tous  les  choix 
possibles  sont  represents  dans  la  base  de  donnees.  En  pratique,  le  jeu  de  coordonnees  de  trois 
centroides  qui  reproduit  le  mieux  possible  un  cadre  orthogonal  sera  choisi,  puisqu’il  sera 
relativement  robuste  par  rapport  aux  erreurs  de  localisation  des  centroides. 

Combinaison  de  Papparence  et  de  la  geometrie  :  Afm  de  combiner  la  geometrie  et 
l’apparence,  la  geometrie  est  utilisee  comme  prefiltre  pour  l’appariement  base  sur  Papparence. 
On  utilise  notamment  une  quantification  approximative  des  parametres  geometriques  {a,  b)  pour 
definir  un  tableau  de  recherche  a  deux  dimensions.  Chaque  case  du  tableau  contient  les  vecteurs 
d'apparence  (soit  les  vecteurs  d’energie  orientes)  des  images  de  reference  dont  les  parametres 
geometriques  derives  sont  couverts  par  fetendue  de  la  case.  Pendant  l’appariement,  un  echantillon 
sert  a  indexer  une  case  d’apres  ses  parametres  geometriques  recuperes;  par  la  suite,  la  meilleure 
correspondance  est  etablie  d’apres  le  produit  scalaire  le  plus  eleve  entre  le  vecteur  d’apparence  de 
P  echantillon  et  tous  les  vecteurs  d’apparence  contenus  dans  la  case  indexee. 

Resultats  empiriques  :  La  presente  section  decrit  une  experience  permettant  d’evaluer 
Pefficacite  de  la  methode  proposee  d’appariement  d’ echantillons  video  a  la  base  de  donnees 
d’images  de  reference.  Les  entrees  de  la  base  de  donnees  et  les  echantillons  individuels  sont 
caracterises  par  des  quadruplets  de  regions  d’images  definies  selon  la  texture.  L'apparence  de 
chacune  des  zones  est  saisie  au  moyen  de  leurs  vecteurs  d’energie  orientes  a  seize  dimensions.  La 
geometrie  relative  des  zones  est  saisie  a  faide  d'invariants  affins  a  deux  dimensions. 

La  base  de  donnees  a  ete  garnie  a  l’aide  d’orthoimages  correspondant  a  cinq  lieux  geographiques 
differents.  Les  orthoimages  ont  ete  saisies  dans  la  partie  visible  du  spectre  a  une  resolution 
d’intensite  de  huit  bits  par  pixel  et  a  une  resolution  spatiale  approximative  de  un  metre  au  sol  par 
pixel.  Les  parametres  affins  ont  ete  quantifies  de  maniere  uniforme  dans  des  fichiers  d’une  taille 
de  0,5  avec  un  chevauchement  de  1,0  entre  les  fichiers  adjacents.  Ces  unites  ont  ete  retenues  a  la 
suite  d’une  inspection  empirique  afin  de  s’ assurer  que  felagage  des  mises  en  correspondance 
fondees  sur  la  geometrie  couvrirait  tout  fespace  entre  une  desambiguisation  quasi  complete  et 
aucune  desambiguisation  de  la  correspondance.  Une  fois  constitute,  la  base  de  donnees 
comprenait  587  entrees  distinctes  (tirees  de  sous-regions  des  cinq  orthoimages).  A  titre 
d’ illustration,  l’image  de  la  figure  1  presente  un  exemple  d’entree  dans  la  base  de  donnees. 

Les  echantillons  ont  ete  elabores  a  partir  de  videos  aeriennes  synthetiques  des  regions 
correspondant  aux  cinq  orthoimages  utilisees  pour  elaborer  la  base  de  donnees.  Pour  chacune  des 
regions,  les  images  en  survol  ont  ete  generees  suivant  deux  directions  (par  ex.  des  lignes  de  vol 
nord-sud  ou  est-ouest),  trois  resolutions  spatiales  (la  ou  le  support  et  la  resolution  de  P  image  le 
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permettaient)  et  deux  obliquites  (nadir  et  30  degres  hors  nadir).  En  tout,  on  obtient  un  ensemble 
de  32  echantillons.  A  titre  d’ illustration,  la  figure  2  presente  l’image  d’un  echantillon  qui 
correspond  a  l’entree  de  la  base  de  donnees  illustree  a  la  figure  1. 

Dans  l’ensemble,  lorsque  les  32  echantillons  ont  ete  indexes  dans  la  base  de  donnees  a  l’aide  de  la 
methode  decrite,  le  meilleur  resultat  a  ete  une  correspondance  exacte  dans  75  %  des  cas.  De  plus, 
la  correspondance  exacte  se  situait  parmi  les  deux  meilleurs  resultats  dans  88  %  des  cas  et  parmi 
les  trois  meilleurs  resultats  dans  100  %  des  cas.  En  outre,  on  a  egalement  tente  d’effectuer  une 
indexation  uniquement  fondee  sur  l’apparence  (c.-a-d.  en  ignorant  le  prefiltre  geometrique);  on  a 
observe  que  l’exactitude  des  correspondances  etait  moindre  dans  ce  cas,  ce  qui  souligne 
E importance  de  combiner  l’apparence  et  la  geometrie  pour  V indexation  des  images. 

Resume  :  Le  rapport  presente  une  methode  permettant  de  mettre  en  correspondance  des  images 
video  aeriennes  et  1’orthoimagerie  de  reference  correspondante,  que  conti ennent  habituellement 
les  bases  de  donnees  geospatiales.  La  methode  combine  l’apparence  des  images,  caracterisee  par 
des  regions  definies  selon  la  texture,  et  la  geometrie  des  images,  caracterisee  par  les  relations 
spatiales  entre  les  regions  texturees.  De  par  leur  conception,  les  methodes  de  mise  en 
correspondance  sont  robustes  pour  toute  une  gamme  de  deformations  photometriques  et 
geometriques  d'une  image  a  fautre,  notamment  les  variations  de  contraste  des  tons  de  gris  et  les 
transformations  geometriques  affines.  Des  evaluations  empiriques  donnent  une  indication  du 
potentiel  de  la  methode.  La  methode  elaboree  peut  servir  a  la  mise  en  oeuvre  d'une  etape  de 
pretraitement  pour  des  methodes  existantes  de  superposition  damages  video  d’apres  des  images  de 
reference.  De  fagon  particuliere,  elle  peut  servir  a  initialiser  des  algorithmes  pour  la  superposition 
automatisee  d'images  en  foumissant  une  position  approximative  des  images  video  par  rapport  aux 
images  de  reference.  II  serait  important  d’orienter  la  recherche  future  en  soumettant  la  methode  a 
des  evaluations  empiriques  supplementaires,  et  specifiquement  a  une  evaluation  utilisant  des 
donnees  operationnelles  reelles. 
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Figure  23.  Exemple  d’une  entree  de  la  base  de  donnees.  A  gauche,  une  orthoimage  d’origine.  A 
droite,  les  regions  d’interet  selectionnees  automatiquement,  sur  lesquelles  se  superposent  des 
symboles  geometriques  (cercle,  ellipse,  carre  triangle)  mettant  en  evidence  un  quadruplet  qui 
correspond  a  une  entree  de  la  base  de  donnees. 
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Figure  24.  Exemple  d’un  echantillon  video.  En  haut,  un  cliche  individuel  du  survol  d’une  partie 
de  V orthoimage  representee  a  la  figure  1.  Au  centre,  une  mosaique  d’images  de  la  video 
aerienne.  En  has,  les  regions  d’interet  selectionnees  automatiquement,  sur  lesquelles  se 
superposent  des  symboles  geometriques  (cercle,  ellipse,  carre  triangle)  mettant  en  evidence  la 
correspondance  avec  V entree  de  la  base  de  donnees  representee  a  la  figure  23. 
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10.2 


Lidar  AVS  pour  la  detection  d’obstacles  a  I’interieur 
d’aerosols 


X.  Zhu'  ,  P.  Church  et  M.  Labrie 

Neptec  Design  Group  Ltd 
t Papier  presente  (photographie  ci-dessous) 


Resume  :  La  capacite  de  detecter  des  obstacles  ou  le  sol  a  l’interieur  d’aerosols  est  une 
caracteristique  tres  recherchee  aux  fins  de  nombreuses  operations  par  helicoptere.  Les  pilotes 
d’helicoptere  ont  besoin  d’une  aide  visuelle  pour  assurer  la  securite  en  vol  et  a  l’atterrissage  en 
presence  de  voiles  blancs  qui  peuvent  etre  dus  a  des  phenomenes  meteorologiques  naturels 
comme  le  brouillard  et  les  tempetes  de  neige,  ou  a  des  nuages  de  neige  circulaires  produits  par  le 
souffle  du  rotor  d’un  helicoptere.  De  meme,  les  pilotes  d’helicoptere  doivent  voir  les  obstacles  ou 
le  sol  lorsque  des  nuages  de  poussiere  sont  souleves  par  le  souffle  du  rotor  de 
l’helicoptere  a  l’atterrissage  sur  un  sol  sablonneux.  Le  present  document  decrit  un  dispositif  lidar 
AVS  specialement  congu  pour  detecter  des  obstacles  a  l’interieur  d’aerosols  aux  fins  de  la 
manoeuvre  d’helicopteres. 

Le  systeme  AVS  (systeme  visionique  augmente)  est  un  systeme  d’aide  a  la  vision  congu  pour 
aider  les  pilotes  d’helicoptere  a  naviguer  dans  des  conditions  meteorologiques  extremement 
mauvaises.  L’un  des  aspects  cles  de  l’AVS  reside  dans  l’utilisation  de  capteurs  actifs  pour 
detecter  des  obstacles  et  «  voir  a  travers  »  de  mauvaises  conditions  meteorologiques.  Comme  le 
lidar  peut  exploiter  la  fonction  de  commande  de  la  discrimination  temporelle  afin  de  supprimer 
l’effet  de  diffusion  par  la  poussiere  et  le  brouillard,  il  peut  generalement  «  voir  »  plus  loin  que  les 
capteurs  passifs,  par  exemple  l’oeil  humain  et  les  cameras  IR;  c’est  un  bon  complement  des 
capteurs  passifs  pour  l’AVS.  Les  defis  que  pose  l’utilisation  du  lidar  en  presence  d’aerosols 
tiennent  non  seulement  a  la  grande  puissance  laser  necessaire  pour  penetrer  les  aerosols,  mais 
aussi  a  la  necessite  de  disposer  d’une  haute  dynamique  de  detection  et  de  supprimer  la  diffusion 
par  les  aerosols  devant  le  lidar.  Bien  que  les  lidars  a  eclats  ou  les  cameras  a  commande  laser 
puissent  exploiter  les  fonctions  de  discrimination  temporelle  pour  supprimer  les  signaux 
provenant  des  aerosols,  leur  puissance  optique  n’est  en  general  pas  suffisante  pour  penetrer 
l’aerosol  et  couvrir  une  zone  de  taille  raisonnable.  Les  lidars  a  balayage  classiques  ont  ete  utilises 
pour  detecter  des  obstacles  a  l’interieur  d’aerosols  avec  un  succes  limite.  Ils  utilisent 
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normalement  un  systeme  optique  avec  faisceau  de  depart  et  faisceau  de  retour  co-alignes  devant 
le  dispositif  optique  de  balayage.  Par  consequent,  le  faisceau  de  retour  provenant  d’une  cible  est 
toujours  renvoye  au  recepteur  quelle  que  soit  la  distance  de  la  cible.  La  diffusion  par  l’aerosol 
devant  une  fenetre  lidar  peut  saturer  le  recepteur  et  interrompre  ainsi  le  traitement  des  signaux. 

Le  lidar  AVS  de  Neptec  offre  une  conception  optique  autosynchronisee,  utilisant  une  relation  de 
triangulation  pour  fractionner  le  faisceau  de  retour  qui  sera  accepte  par  le  recepteur  TOF  (duree 
de  trajet)  en  fonction  de  la  distance  de  la  cible.  En  outre,  cette  propriete  se  maintient  lors  du 
balayage  optique  a  haute  vitesse.  Ainsi,  le  lidar  AVS  peut  supprimer  les  signaux  de  retour  dus  a  la 
diffusion  proche  par  l’aerosol  et,  en  meme  temps,  il  possede  la  sensibilite  et  la  dynamique 
necessaires  pour  detecter  des  obstacles  ou  le  sol  a  l’interieur  de  l’aerosol.  Neptec  a  mene  des 
experiences  visant  a  etudier  l’effet  de  diffusion  des  aerosols  atmospheriques  sur  le  lidar,  le  FLIR 
et  la  vision  humaine  en  utilisant  un  corridor  de  propagation  et  d’ evaluation  des  aerosols  a  RDDC 
Valcartier  (Quebec,  Canada).  Neptec  a  egalement  effectue  des  essais  en  vol  d’un  concept  de  lidar 
AVS  a  bord  d’un  helicoptere  Bell  412  du  CNRC  pres  des  rives  du  lac  Crash,  au  nord  d‘ Ottawa 
(Canada).  Le  present  document  decrit  ce  concept  de  lidar  AVS  et  ses  applications;  et  etudie  les 
resultats  obtenus  en  ce  qui  concerne  la  penetration  des  aerosols  et  la  detection  des  obstacles. 
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10.3  Validation  experimentale  d’un  modele  parametrique  de 
LVN 


Paul  J.  Thomas'*,  Sion  Jennings**,  Todd  Macuda**,  Robert  S.  Allison***,  and  Richard 

Hornsey*** 

*Topaz  Technologies,  Toronto 

*  ^Institute  for  Aerospace  Research,  National  Research  Council  of  Canada,  Ottawa 
***Centre  for  Vision  Research,  York  University,  Toronto 
^ Papier  presente  (photographic  ci-dessous) 


Aper^u  et  but  :  Dans  le  cadre  des  efforts  visant  a  creer  une  imagerie  synthetique  realiste,  il 
importe  de  modeliser  avec  precision  les  fluctuations  du  signal  de  sortie  des  LVN  pour  un 
eclairement  energetique  faible  et  uniforme.  Le  modele  de  LVN  a  ete  con^u  pour  faciliter  les 
comparaisons  avec  les  experiences  de  laboratoire.  Plus  particulierement,  le  modele  a  cree  des 
«  images  de  LVN  a  faible  signal  »  d’une  scene,  en  examinant  les  taches  photoniques  une  par  une, 
a  l’aide  d’un  traitement  statistique  de  la  generation  de  photoelectrons  a  la  photocathode  des  LVN. 
Les  statistiques  temporelles  et  spatiales  de  cette  imagerie  synthetique  pourraient  etre  comparees 
en  detail  aux  resultats  des  experiences  de  laboratoire.  Les  images  LVN  plus  intenses  ont  ete 
traitees  comme  etant  la  somme  d’une  sequence  d’ images  a  faible  signal,  ou  les  parametres  des 
LVN  pouvaient  varier  d’une  image  a  l’autre.  Cette  methode  a  permis  de  modeliser  l’etalement  du 
point  (point  optique  et  halo  dans  les  LVN)  et  d’ avoir  un  controle  automatique  du  gain  pratique 
pour  les  comparaisons  avec  les  experiences.  Dans  le  cadre  de  ces  travaux,  nous  decrivons  un 
modele  a  faible  signal  ayant  ete  utilise  pour  creer  des  images  synthetiques.  Les  images 
synthetiques  ont  ensuite  ete  evaluees  a  l’aide  de  parametres  statistiques  calcules  a  partir  des 
images.  Des  comparaisons  ont  ete  faites  pour  les  mesures  en  laboratoire,  jusqu’au  niveau  du 
signal  d’un  photon  unique.  La  probability  de  generer  des  photoelectrons  a  un  point  donne  de 
l’espace  et  du  temps  presentait  un  interet  particulier. 

Contexte  :  Dans  les  simulateurs  militaires,  le  nombre  d’ images  par  seconde  et  les  caracteristiques 
de  resolution  spatiale  peuvent  limiter  le  temps  disponible  pour  generer  chacune  des  images  d’un 
modele  de  scene  observe  avec  des  LVN.  On  s’attend  a  ce  qu’il  y  ait  une  diminution  concomitante 
de  la  «  fidelite  »  de  l’image.  Dans  le  cas  des  experiences  psychophysiques,  de  petits  effets 
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peuvent  parfois  donner  lieu  a  un  biais  fortement  non  lineaire  aux  resultats,  de  sorte  que  Ton 
s’ attend  a  ce  que  la  «  fidelite  »  de  1’ image  soit  importante.  Par  consequent,  il  convient  de 
s’assurer  que  les  images  synthetiques  (obtenues  a  l’aide  d’un  simulateur)  qui  sont  utilisees  pour 
ces  experiences  sont  exemptes  d’ anomalies  spatiales  ou  temporelles  qui  seraient  generees  par  le 
processus  de  simulation  en  lui-meme.  II  n’est  pas  necessaire  d’imposer  des  contraintes 
rigoureuses  quant  au  nombre  d’ images  par  seconde  ou  a  la  resolution  spatiale  dans  le  «modele  de 
laboratoire»  de  la  sortie  LVN,  et  Ton  peut  ainsi  prendre  le  temps  requis  pour  modeliser  avec 
precision  les  processus  physiques  a  l’interieur  des  LVN.  Le  processus  de  generation  d’images  qui 
simule  de  pres  les  processus  physiques  qui  se  deroulent  dans  les  LVN  devrait  permettre  d’obtenir 
une  meilleure  «fidelite»  qu’un  generateur  dans  lequel  la  vitesse  de  fonctionnement  ou  d’autres 
parametres  constituent  les  criteres  de  conception  les  plus  importants. 

Un  exemple  important  est  le  bruit  quantique  du  signal  du  a  Parrivee  aleatoire  des  photoelectrons 
(loi  de  Poisson).  Les  fondements  physiques  de  la  creation  d’un  photoelectron  isole  est 
bienconnue.  Si  l’eclairement  energetique  d’entree  est  suffisamment  faible,  chaque  canal  de 
l’intensificateur  d’images  des  LVN  peut  etre  examine  independamment.  Ensuite,  les  signaux 
sequentiels  dans  un  meme  canal  peuvent  etre  consideres  comme  etant  suffisamment  eloignes  les 
uns  des  autres  (en  moyenne)  pour  pouvoir  etre  trades  isolement.  Cette  methode  repose  sur 
l’hypothese  que  la  tache  du  photoelectron  traverse  les  LVN  tres  rapidement,  comparativement  au 
temps  moyen  entre  les  taches  ou  au  temps  de  recuperation  d’un  canal  de  LVN  apres  chaque 
arrivee  d’electrons  de  multiplication. 

L’hypothese  du  «faible  signal»  a  ete  verifiee  pour  des  conditions  d’eclairement  lumineux 
courantes,  en  choisissant  un  intervalle  suffisamment  court  (une  «tranche  de  temps»)  pour 
l’application  du  modele.  Le  processus  a  ete  repete  pour  des  tranches  de  temps  subsequentes.  Entre 
ces  tranches,  les  conditions  des  LVN  (p.  ex.  le  gain)  pouvaient  etre  modifiees  afm  de  s’ajuster  aux 
effets  physiques  attendus.  Les  signaux  lumineux  associes  a  differentes  tranches  de  temps  ont  ete 
additionnes  dans  le  but  d’obtenir  la  sortie  totale  pour  le  temps  d’integration  souhaite  (p.  ex. 
50ms).  Bien  que  cette  methode  de  modelisation  de  la  sortie  LVN  soit  facilement  justifiable  d’un 
point  de  vue  physique,  elle  risque  de  necessiter  un  temps  de  calcul  considerable  lorsque  la  tranche 
de  temps  est  courte  par  rapport  au  temps  d’integration;  c’est  pourquoi  la  methode  n’est 
generalement  pas  utile  pour  la  simulation  en  temps  reel.  Cependant,  on  s’ attend  a  ce  que  le 
realisme  du  modele  soit  excellent  et  comparable  aux  experiences  realisees  avec  le  signal  le  plus 
faible,  soit  la  creation  d’un  photoelectron  unique.  Des  mesures  de  «realisme»  sont  requises  et 
elles  doivent  etre  verifiables  sur  le  plan  quantitatif  en  laboratoire. 

Des  experiences  physiques  adequates  en  laboratoire  (par  opposition  aux  experiences 
psychophysiques)  peuvent  valider  ce  genre  de  «modele  de  tranche  de  temps»  et  aider  a 
determiner  les  parametres  de  l’imagerie  synthetique  sur  le  plan  statistique  qui  sont  des  indicateurs 
sensibles  du  comportement  de  modele  inapproprie.  Une  fois  qu’un  ensemble  solide  de  parametres 
aura  ete  constitue,  celui-ci  pourra  etre  applique  a  des  affichages  semblables  du  simulateur  en  vue 
d’ identifier  les  anomalies  potentielles. 

Systeme  (revaluation  en  laboratoire: 

a)  Taches  photoniques  :  Pour  mesurer  les  statistiques  des  images  (hautement  non  uniformes) 
generees  par  les  signaux  lumineux  faibles  provenant  d’une  source  uniforme,  la  reponse  des  LVN 
a  un  seul  photon  en  «reimageant»  une  partie  de  l’ecran  fluorescent  d’un  LVN  dans  un 
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photomultiplicateur.  Le  bruit  du  photomultiplicateur  a  ete  facilement  isole  du  signal  du  LVN  a  la 
sortie  de  l’ecran  fluorescent  a  l’aide  d’un  seuil  binaire  applique  a  l’amplitude  du  signal.  (Les 
moyennes  et  les  demi-largeurs  des  deux  distributions  d’ amplitude  sont  generalement  tres 
differentes.)  Cette  methode  a  permis  d’effectuer  une  mesure  sensible  de  la  reponse  temporelle  des 
LVN  a  des  intensites  lumineuses  suffisamment  faibles  pour  que  les  taches  photoniques 
individuelles  soient  bien  separees  dans  le  temps.  Les  experiences  et  le  modele  de  faible  signal  ont 
permis  de  mesurer  les  arrivees  ponctuelles  de  photoelectrons  et,  pour  cette  raison,  le  modele  peut 
etre  compare  aux  experiences,  au  niveau  fondamental. 

b)  Imagerie  des  halos  :  Pour  effectuer  des  mesures  de  la  reponse  spatiale  de  LVN  a  une  source 
de  lumiere  localisee,  on  a  remplace  l’oculaire  des  LVN  par  une  camera  et  l’on  a  enregistre 
l’image  de  l’ecran  fluorescent  (des  LVN).  L’amplitude  de  la  source  lumineuse  pouvait  etre 
modifiee  sur  cinq  ordres  de  grandeur  en  modulant  la  largeur  d’impulsion. 

c)  Comportement  temporel :  Une  configuration  «sonde-pompe»  de  la  source  lumineuse  dans  les 
reglages  de  la  camera  a  ete  utilisee  pour  examiner  le  comportement  temporel  des  parametres 
LVN,  en  particular  le  controle  automatique  du  gain  (CAG)  a  des  intensites  de  signal  plus  elevees. 

Statistiques  relatives  aux  taches  photoniques  :  Le  photomultiplicateur  a  permis  de  mesurer  la 
reponse  des  LVN  a  des  taches  dues  a  un  seul  photon  avec  une  resolution  temporelle  superieure  a 
10  microsecondes.  La  resolution  spatiale  etait  ajustable.  Seule  une  zone  contigue  de  l’ecran 
fluorescent  des  LVN  etait  imagee  a  chaque  instant.  On  a  determine  la  constante  de  decroissance 
temporelle  de  l’ecran  fluorescent  a  partir  de  la  decroissance  temporelle  des  taches  dues  a  un  seul 
photon.  Les  histogrammes  de  l’intervalle  de  temps  entre  les  taches  et  l’amplitude  des  evenements 
ont  permis  de  valider  l’hypothese  voulant  que  le  processus  de  photodetection  suit  la  loi  de 
Poisson  dans  les  LVN  et  d’obtenir  des  donnees  experimentales  destinees  a  des  comparaisons 
sensibles  des  images  modelisees  avec  les  images  obtenues  par  les  LVN. 

Imagerie  des  halos  et  comportement  temporel  :  Une  camera  numerique  commerciale  a  ete 
utilisee  pour  enregistrer  la  sortie  d’un  ecran  fluorescent  de  LVN  en  reponse  a  une  source 
lumineuse  dont  la  portee,  l’ouverture  et  l’intensite  pouvait  etre  controles  avec  precision. 
L’intensite  moyenne  a  ete  modifiee  avec  precision  en  changeant  le  cycle  de  fonctionnement  de  la 
source  lumineuse  (DEL)  qui  fonctionnait  en  mode  pulse.  L’instrument  permettait  de  modeliser  le 
halo.  Une  deuxieme  source  lumineuse,  synchronisee,  a  ete  employee  pour  regler  le  controle 
automatique  du  gain  des  LVN.  En  controlant  la  synchronisation  des  sources  lumineuses, 
on  a  pu  determiner  experimentalement  le  comportement  temporel  du  controle  automatique  du 
gain  des  LVN. 
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techniques  to  explore  and  model  the  representation  of  the  world  in  the  visual  cortices  of  primates. 
From  1995  to  present,  Dr.  Gaska  has  worked  as  contractor  to  the  Air  Force  and  used  vision 
science  and  visual  performance  models  to  aid  in  the  design  of  camouflage,  laser  eye  protection 
and,  currently,  flight  simulation  technologies. 

A.8  Avi  Parush 

Avi  Parush's  professional  career  in  human  factors  engineering  (HFE),  usability  engineering,  and 
human-computer  interaction  (HCI)  spans  over  20  years.  He  has  been  involved  in  user-interface 
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design  and  testing  in  a  large  variety  of  domains  and  projects.  Parush  is  the  founder  and  editor  in 
chief  of  the  Journal  of  Usability  Studies.  His  academic  background  is  in  cognitive-experimental 
psychology  and  he  is  presently  a  professor  of  psychology  at  Carleton  University,  Ottawa.  His 
main  research  focus  are  on  spatial  cognition,  way-finding  and  orientations  theories  and 
systems,  simulator-based  learning  and  training,  and  the  application  of  human  factors  and 
usability  approaches  and  principles  in  the  healthcare  system  with  the  aim  of  reducing  errors  and 
increasing  safety. 

A.9  Robert  Allison 

Robert  Allison  is  interested  in  basic  and  applied  aspects  of  stereoscopic  depth  perception.  His 
areas  of  expertise  are  the  psychophysical  and  computational  investigation  of  depth  perception, 
analysis  of  eye  movements,  and  perceptual  issues  in  human  spatial  orientation  and  virtual  reality 
systems.  He  is  currently  an  Associate  Professor  at  York  University  (Toronto  Canada)  in  the 
department  of  Computer  Science  and  Engineering  with  appointments  at  the  Centre  for  Vision 
Research  and  the  graduate  program  in  Psychology.  He  received  his  B.A.Sc.  in  Computer 
Engineering  from  the  University  of  Waterloo,  an  M.A.Sc.  in  Biomedical  Engineering  from  the 
University  of  Toronto  and  his  Ph.D.  in  Biology  from  York  University. 

A.10  Don  Donderi 

Don  Donderi  is  a  co-founder  and  Principal  Consultant  of  Human  Factors  North,  Inc.,  a  Toronto- 
based  Human  Factors  and  Ergonomics  Consulting  Firm.  He  is  also  an  associate  professor  in  the 
department  of  psychology  at  McGill  University,  Montreal.  While  in  graduate  school  during  the 
cold  war,  he  worked  at  IBM  in  the  United  States  on  the  visual  perception  demands  of  aerial 
reconnaissance.  After  graduating  with  a  doctorate  in  experimental  psychology  from  Cornell 
University  in  1962,  he  joined  the  Psychology  Department  of  McGill  University  in  Montreal.  In 
1982  he  co-founded  Human  Factors  North,  a  Toronto-based  human  factors/ergonomics  consulting 
firm.  Since  then  he  has  worked  with  private  companies  and  civil  and  military  agencies  involved 
with  flight  simulation,  marine  navigation,  rail  transport,  road  transport,  air  traffic  control,  nuclear 
power,  and  marine  search  and  rescue.  He  has  carried  out  field  research  on  marine  navigation  and 
on  search  and  rescue  in  the  Canadian  Arctic  and  in  the  Atlantic  Ocean,  in  cooperation  with  the 
Canadian  and  US  Coast  Guards  and  the  Canadian  Department  of  Transport.  He  has  designed 
wheelhouses  for  Canadian  Coast  Guard  cutters.  He  has  carried  out  research  work  and  literature 
reviews  on  marine  navigation  displays  for  Defence  Research  and  Development  -  Toronto.  His 
work  has  been  reported  in  peer-reviewed  scientific  journals,  at  scientific  and  technical 
conferences  and  in  many  technical  reports.  In  2004,  his  work  on  marine  integrated  navigation 
displays  was  published  in  Displays  and  Journal  of  Navigation ,  and  in  2006  he  wrote  a 
comprehensive  review  of  visual  complexity  published  in  Psychological  Bulletin. 

A.11  Vitaly  Zholudev 

Mr.  Vitaly  Zholudev  received  BSc  Honours  and  Masters  degrees  in  computer  science  from  York 
University  in  Toronto  in  2004  and  2006,  respectively.  As  part  of  his  MSc  work,  Mr.  Zholudev 
produced  a  thesis  titled,  Toward  Video  to  Geospatial  Reference  Image  Indexing.  Since  2004,  Mr. 
Zholudev  has  been  a  member  of  the  Computer  Vision  Laboratory  at  York  University,  from  2004- 
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2006  as  graduate  student  and  from  2006-present  as  a  full-time  research  associate.  His  research 
interests  include  computer  vision,  in  particular  image  registration  and  indexing. 


A.12  X.  Zhu 

X.  Zhu  is  the  principal  optical  engineer  at  Neptec.  He  received  a  M.Sc.  in  physics  from  Queen’s 
University  at  Kingston,  Canada  in  1992  and  a  Ph.D.  in  engineering  physics  from  McMaster 
University  at  Hamilton,  Canada  in  1996.  He  worked  as  an  opto-electronic  device  designer  at 
Perkin-Elmer  and  as  an  instrumentation  designer  at  JDS  Uniphase  before  joining  Neptec. 

Zhu  has  published  numerous  papers  in  Applied  Optics,  IEEE  Photonics  Technology  Letters, 
Journal  of  the  Optical  Society  of  America  and  SPIE  proceedings  in  laser  technology  and 
applications.  He  holds  a  number  of  patents  including  Neptec  patents  on  optical  design  of  LMS 
(laser  metrology  system)  and  TriDAR  scanner. 

A.13  Paul  Thomas 

Dr  Paul  J.  Thomas  (PhD,  Physics,  1977)  is  the  president  of  Topaz  Technology  Incorporated,  a 
consulting  and  R&D  firm  in  Toronto.  His  interests  include  NVD  and  the  application  of  lasers  and 
imagers  to  3D  remote  sensing. 
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(U)  The  Advanced  Deployable  Day/Night  Simulation  Technology  Demonstration  Project  was 
initiated  to  design,  develop,  and  deliver  transportable  visual  simulations  that  jointly  provide 
night-vision  and  high-resolution  daylight  capability.  The  project  includes  research  and 
development  on  deployable  display  technologies  for  realistic  day  and  night  training 
operations,  extends  the  knowledge  of  human  factors  with  night  vision  devices,  and  the 
ability  to  represent  dangerous  or  extreme  scenarios  for  day  and  night  operations  in 
general.  On  November  13th  and  14th  2007  the  Advanced  Deployable  Day/Night 
Simulation  Technical  Demonstration  Project  held  a  symposium  at  Defence  Research 
Development  Canada  in  Toronto.  Many  contributions  were  made  by  professionals  in  the 
fields  of  human  factors,  image  generation,  projection  technologies,  and  photogrammetry. 
The  abstracts  of  papers  presented  at  the  symposium  are  in  this  technical  report,  in  both 
official  languages. 

The  intent  of  this  effort  is  to  aid  operational  readiness  by  advancing  the  visual  simulation 
capabilities  of  training  simulators  so  that  they  can  be  deployed  for  mission  rehearsal.  This 
objective  can  be  achieved  by  developing  high-resolution,  multi-spectral  visual  simulation 
capabilities  that  integrate  advancements  of  laser  projection  technology,  and 
physics-based  modelling  of  night  vision  devices  with  terrain  representations  that  can 
incorporate  reconnaissance  data. 

(U)  Le  Projet  du  simulateur  deployable  avance  pour  la  vision  de  jour  et  de  nuit  (projet  de 
demonstration  de  technologie)  prevoit  la  conception,  le  developpement  et  la  livraison  d'un 
simulateur  transportable  qui  fournira  a  la  fois  une  capacite  de  vision  nocturne  et  une 
capacite  d'affichage  diurne  de  haute  resolution.  Ce  projet  comprend  des  travaux  de 
recherche  et  de  developpement  sur  la  technologie  des  systemes  d'affichage  deployables 
pour  des  operations  d’entrainement  realiste  de  jour  et  de  nuit  et  augmente  les 
connaissances  de  I’ergonomie  relativement  aux  appareils  de  vision  nocturne  ainsi  que  la 
capacite  de  representer  des  scenarios  dangereux  ou  extremes  pour  les  operations  de  jour 
et  de  nuit  en  general.  Les  13  et  14  novembre  2007,  les  responsables  du  Projet  du 
simulateur  deployable  avance  pour  la  vision  de  jour  et  de  nuit  ont  tenu  un  symposium  a 
Recherche  et  developpement  pour  la  defense  Canada  -  Toronto.  De  nombreuses 
presentations  ont  ete  faites  par  des  professionnels  dans  les  domaines  suivants  : 
ergonomie,  production  d'images,  technologies  de  projection  et  photogrammetrie.  Les 
resumes  des  presentations  qui  ont  ete  faites  pendant  le  symposium  se  trouvent  dans  le 
present  rapport  technique,  dans  les  deux  langues  officiels. 

L’oeuvre  present  vise  a  ameliorer  I’etat  de  preparation  operationnelle  en  perfectionnant  les 
capacites  de  simulation  visuelle  des  simulateurs  destines  a  I’entraTnement  de  sorte  qu’ils 
puissent  etre  utilises  pour  les  repetitions  en  vue  d’une  mission.  La  realisation  d’un  tel 
objectif  passe  par  le  developpement  de  capacites  de  simulation  visuelle  multi  spectrale  a 
haute  resolution  integrant  les  progres  realises  dans  les  domaines  de  la  technologie  de 
projection  laser,  et  de  la  modelisation  des  dispositifs  de  vision  nocturne  basee  sur  la 
physique  avec  des  representations  de  terrain  qui  pourraient  comprendre  des  donnees  de 
reconnaissance. 
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